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Preface 


The effort to understand human behavior must itself be one of the 
oldest of human behaviors. But for all the centuries of effort, there is no 
compelling evidence to convince us that we do understand human behavior 
very well. The application of that reasoning and of those procedures which 
together we call "the scientific method” to the understanding of human 
behavior is of relatively recent origin. What we have learned about human 
behavior in the short period — let us say from the founding of Wundt’s 
laboratory in Leipzig in 1879 until now — is out of all proportion to what 
we learned in preceding centuries. The success of the application of sci- 
entific method to the study of human behavior has given us new hope for 
an accelerating return of knowledge on our investment of time and effort. 
But most of what we want to know is still unknown. The application of 
scientific method has not simplified human behavior. It has perhaps shown 
us more precisely just how complex it really is. 

In the contemporary behavioral science experiment it is the research 
subject we try to understand. He serves as our model of man in general, or 
at least of a certain kind of man. We know that his behavior is complex. 
We know it because he does not behave exactly as any other subject be- 
haves. We know it because sometimes we change his world ever so slightly 
and observe his behavior to change enormously. We know it because some- 
times we, change Ws world greatly and observe his behavior to change not 
at all. We know it because the "same” careful experiment conducted in one 
place at one time yields results very different from the results of an experi- 
ment conducted in another place at another time. We know his complexity 
because he is so often able to surprise us with his behavior. 

Most of this complexity of human behavior may be in the nature of 
the organism. But some of it may derive from the social nature of the 
psychological or behavioral experiment itself. Some of the complexity of 
man as we know it from his model, the research subject, resides not in the 
subject himself but rather in the particular experimenter and in the inter- 
action between subject and experimenter. 

That portion of the complexity of human behavior which can be 
attributed to the experimenter as another person and to his interaction with 
the subject is the focus of this book. 

Whatever we can learn about the experimenter and his interaction 
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and the research situation In this sense the study of the b^aviord scientet- 
ttpentsButer is crucial, there are important implications for how we conduct 

and how we assess out research . 

There is another sense m which the study of the experimenter and his 
interaction with his subiect is important In this sense it is not at all crucial 
that the experimenter happens to be the collector of scientific data He mign 
as well be a teacher interacting with his student, an employer mteractmg 
with his employee, a healer interacting with his patient, or any person inter- 
acting with another In this sense, the experimenter himself serves as a 
model of man or of one kind of man His subject also serves as a model, 
and the interaction between them, the situation arising from their encounter, 
serves as a model of other more or less analogous situations From the 
behavior of the experimenter, we may learn something of consequence 
about human behavior m general 


This book IS divided into three parts The first deals with the general 
nature of the effects an experimenter may have on the results of his re- 
search The second describes a program of research on the effects of a 
particular type of experimenter variable on the results of research The 
third takes up some methodological implications of the data presented 
Part I consists of two sections The first contains a discussion of those 
effects of the expenmenter that do not influence the subject’s response 
even though they may affect the results of the research When the experi- 
menter serves as observer of the subject’s behavior, when he records the 
data, summarizes, analyzes, and interprets the data, he may err m signifi- 
cant ways but not by directly affecting the subject’s response 

Hov.cvcr, when the expenmenter interacts with the subject, his own 
more enduring attributes, his attitudes, and his expectancies may prove to 
be significant determinants of the subject’s behavior in the exrinment 
These effects of the experimenter are discussed in the second section of 
Parti 

The last chapter of Part 1 provides a historical introduction to the 
expenmenter variable that is central to the second major part of this book 
That variable is the experimenter’s oncntation toward the outcome of his 
research The hypothesis is put forward that the experimenter’s hypothesis 
his expectancy, can be a significant determinant of the results of his re- 


Part II begins witli a presentation of the evidence that an experi- 
menter s cx^ciancy may serve as sclf-fuIfiUmg prophecy of his subiecls’ 
responses uhen the subjects arc cither humans or animals In these and in 
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following chapters, evidence is presented in sufficient detail for the research 
to be critically evaluated by the reader without reference to papers pub- 
lished elsewhere. This seems particularly necessary in a work that purports 
to offer some suggestions for the further development of behavioral re- 
search methodology. 

In the second section of Part II some factors'^are discussed that have 
been shown to augment, to neutralize, or to reverse the effects of the experi- 
menter’s expectancy on the results of his research. These factors include 
subjects’ expectancies, the nature of data earlier obtained by the experi- 
menter, the motive states aroused in the experimenter, and the subjects* 
view of the experimenter. 

What are the factors that make possible the dramatic effects of the 
experimenter’s expectancy? The third section of Part II is addressed to this 
question. Those characteristics and behaviors of the experimenter associ- 
ated with greater exertion of unintentional influence are discussed. Those 
characteristics of experimental subjects associated with a greater suscepti- 
bility to the influence of the experimenter’s hypothesis are presented. 
Finally, those cues that might serve to communicate the experimenter’s 
expectancy to his subjects are considered. 

The evidence put forth in Part II of the book has clear methodological 
implications for the behavioral researcher. But beyond the methodologi- 
cal implications there are substantive implications as well, for what is 
evidence for the effects experimenters can have on their subjects is also, 
more generally, evidence for the importance in human relations of unin- 
tentional interpersonal influence and, more specifically, the interpersonal 
influence that stems from one person’s expectancy of another’s behavior. 

It seems not overly important that the possibility of unintentional 
influence has been demonstrated. No one will probably be very surprised. 
What does seem important is that the process of unintended social influence 
can be observed in the laboratory, and that its dynamics can now be more 
fully and more systematically investigated. 

Part III deals with a number of methodological implications. In the 
first section of Part III the generality of experimenter effects is discussed 
and a conceptual schema presented which should make it easier to talk 
about the operating characteristics of experimenters. Also the general prob- 
lem of replications and their assessment is related to the earlier sections 
of the book. 

In the second section of Part III concrete proposals are offered which 
the behavioral scientist can employ to reduce and/or assess the effects of 
his and his surrogate’s expectancies on the results of his research. An effort 
has been made to have these suggestions be useful, and they are offered with 
due regard for the practical problems of getting research done, getting it 
done expeditiously, and getting it done economically. 

The suggestions made for the control of experimenter expectancy 
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effects will not, in all probability, solve the problem of “experimenter bias ” 
But that does not seem discouraging In the short time that “scientific 
method ’ has been applied to the study of human behavior it has shown 
Itself to be a good and robust teacher There are things we have learned 
about human behavior m spite of the possible operation of experimenter 
expectancy effects We may do still better by the addition of even imperfect 
safeguards 

Whether we will ever be able to account for all the sources of vanance 
denving from the expenmenter remains a moot question It does not differ 
in kind from the question of whether we will ever be able to account for 

wLfter thrclnLrrVr™"® of 

hemer the concept of indetermmacy applies because it is m the nature 

1 veiT"' of how nmch th“re is we do 

ourrnde^rndmrof™mreTh'’“n <h«'”g“‘*hed contributors to 

this q“Kse» Iv ™lume answers 

want to know and will be able to kam" TteT"" ™ 

perhaps, is whether we can account fnr ^ nieaningful question, 

variance in experiments bv a cons.H Ptoportions of the total 

(and related) effects, and whether wfcarh expectancy 

reduce these sources of error ’ f°"" “f 'ntervention, 

way or another toThe™Sngand*^therere“ eontnbuted in one 

I cannot thank them all The^auftors o, ft!!'? ‘o f"* 

ago-they will forgive me if I express the ^ decade 

Euage than theirs and without actaow "" o’ofioont lan- 
hat the Idea was not mme m the fo^ havmgVgotten 

and happily Donald T Campbell Hamid f ^en thank. 

Riecken all provided more intellectual stimf I ^ Pepinsky. and Henry W 

meat toan I could hope to repay '""’'■'^'■on and personal encomage- 
fBsor Will, am B Bean, Head of the Denao generous than Pro- 

ScTnc«ortr/Na,mnT&“’ fP^X'fte^Dw 

GS-714, W.U.OU, the sup^Tonn^^ 0^77' 

-POthaie.encondrdThi:tI”r™^^^^^^^^^ 
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The Experimenter as Observer 


It was the science of astronomy that made clear that the scientific 
observer was an imperfectly calibrated instrument. In the closing years of 
the eighteenth century, Maskelyne, the astronomer royal at the Greenwich 
Observatory, discovered that his assistant, Kinnebrook, was consistently 
“too slow” in his observation of the movement of stars across the sky. 
During the next six months, despite Maskelyne's admonition, Kinnebrook’s 
recording continued to lag behind Maskelyne’s own recording of the times 
of stellar transits. Maskelyne then felt forced to discharge Kinnebrook. 

Some twenty years later, Bessel, the astronomer at Konigsberg, studied 
this incident and concluded that Kinnebrook’s “error” must have been 
beyond his control. Bessel then compared his own observations of stellar 
transits with those of other senior astronomers and discovered that dif- 
ferences in observation were the rule, not the exception. Furthermore, he 
found these differences or “personal equations” to vary over time. These 
important events in the history of the notation of observer error have been 
described and documented by Boring ( 1950). 


THE GENERALITY OF OBSERVER EFFECTS 

The plan of the next few pages is to indicate some of the disciplines 
that have shown a self-conscious awareness of the problem of observer 
effects. The intent is not to be exhaustive, but rather to be sufficiently rep- 
resentative to establish some consensus with the reader regarding the gen- 
erality of the phenomena. 

The Physical Sciences 

Newton did not have much confidence in his own observational ability, 
and for at least one occasion, the lack of confidence seemed justified. Bor- 
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The Nature of Experimenter Effects 

mg (1962a) noted that Newton did not see and report the absorption lines 
m the pnsmatic solar spectrum, which were visible with Newton’s ap- 
paratus, because of his theoretically based expectations Bonng put it aptly 
and beautifully “To the observing scientist, hypothesis is both friend and 
enemy (p 601) Bonng’s suggestion that observer effects may not be 
observer’s hypothesis is agreed with by N R 
Hanson (1958) and E B Wilson (1952) ^ 

nonratdom'I *at were both 

land T”"® “b^tvers) has been reported by Ros- 

make reflected bght more Inse 

many observers .nei a , phenomenon was viewed by a great 

were^unabletodetel tbe®i."'“^ ‘’=‘5' 0"'y 

a colossal compounLd obse™T?°"’ 'f as at least 

ingly, as this evaluation he ^ downnght fraud Interest- 

coufdnolo“re„er”^ “N-ys" 

a> the physical sciencM^tenTnds'lf'^'^'i*^ operative 

wluch serve to eUminate ’observer efleasThirr^ 'o modem instruments 

under partial control by mechamcti me be brought 

mstrumentation may not elimraate ohT reasonable enough That 

H the mstmment is a diarm. >’* ““'tiafad 

^rurnent is a computer, Ihl onat^n. f °'’*«"'ar It the m- 
Observer effect, or vanabiUty m the re^^n ^ r'^ “ observer 

a e, writing m the Journal of the Roval L ^ scales, has been noted by 
eral error tendency found was the mebn ^ (1927) A gen- 

■ntervals rather than to tenths Empintf to quartern of 

ec revealed to Yule his tendencyTo Zdm”^“ of his own observer ef- 

o favor the numbers 8, 9, 0, and 2 ThM m ' "““bar 7 as a final digit and 
umque to Yule was demonstrated m^std was not at all 

Yule planned to investiom, age statements 


Yule ni '■ ™"s place of the, ‘*'8“ b and an 

Yule planned to investigate oLer!, ™ "8= statements 

SeTf n * h "i <’'> » Hrt plT ""ading in more 

of th^er^o Pofn^ “ observer 

effect to the nature of the observer ' ‘bo nature 

The Biological Sciences 

2r S.“ “ - 

oxtboolss published data setting the nr "’""y yoars the 
aiaxmium allowable dis- 
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crepancy” between blood cell counts of successive samples of blood. Then, 
in 1940, Berkson, Magath, and Hum reported a way of counting blood 
cells more accurately than was ordinarily possible. Each blood cell was 
pierced by a stylus a single time, and each piercing was recorded electrically. 
After collecting many series of blood samples, the investigators were led 
to the inescapable conclusion that laboratory technicians had for years 
routinely reported blood cell counts that could have agreed with one an- 
other so well only 15 to 34 percent of the time. “Published studies involving 
erythrocyte counts, as well as standard texts, disallow discrepancies be- 
tween successive counts so small that they would in most instances neces- 
sarily be exceeded as a matter of chance if counts were accurately made 
and faithfully recorded” (p. 315). The story has many similarities to the 
story of the “N-rays.” Observations were made by many observers, over a 
long perirrd of time, which were consistent with the observers’ expectations 
but inconsistent with the realities of nature as subsequently defined. 

In the field of agricultural statistics, observer eflfects have been well 
demonstrated by Cochran and Watson (1936). These investigators en- 
listed the aid of 12 experienced observers who believed themselves able 
to select young plants whose heights would vary in truly random fashion. 
When actually put to the task, it was found that observen selected plants 
or shoots that were neither representative nor random. Because these ob- 
server errors were not randomly distributed around the "true” values, the 
errors were appropriately defined as biased. Bias, it was found, did not 
remain constant from sampling unit to sampling unit. In the observation of 
shoot heights, as in the observation of stellar transits, observer effects were 
not easily predictable. 

In the field of experimental genetics Fisher (1936) cites Dr. I. Ras- 
mussen, who mentioned that in experimental genetics he, as well as his as- 
sistants, showed an unconscious bias to select the best plants first for 
observation. This type of observer effect, or more specifically “bias,” like 
that shown in the selection of shoot heights and that shown to occur in 
other situations by I'ule and Kendall (1950), has led these authors to pro- 
pose that man may simply be unable to select random sets of events to be 
observed without such external aids as tables of random numbers. 

Perhaps the most important case of observer effects in the history of 
experimental genetics is the one involving the work of Gregor Mendel. 
Mendel, it will be recalled, expected that when hybrid pea plants were 
self-fertilized 75 percent of the offspring would show the dominant pheno- 
type and 25 percent would show the recessive phenotype. That, almost 
exactly, was what Mendel’s observations subsequently showed. Considering 
the relatively small sample sizes reported, Fisher (1936), in a closely 
reasoned logical and statistical analysis, showed that Mendel could not 
reasonably have obtained the data he reported. The data were just too good 
to be likely. We may at least hypothesize the existence of an observer 
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effect or, because of its directionality, a bias, m either Mendel, his assistant, 
or both If the biased error was due to the work of an assistant, the case 
does not stand alone (Shapiro, 1959) Alfred Binet, of intelligence tesUng 
fame, working then in the area of physical anthropology, was forced to dis- 

cephalometnc measure- 
ments (Wolf, 1961) These errors, too, were not randomly distnbuted but 

Dot'uhircn “ o n f hypothesis These errors, like those 

oSiorr ^ necessanly errors of 

repea.ed”e 

“equate XTev“rW^‘“'’“'’ may 

with what actually happens’wTgSl w"r'‘T* 
student of the role of error in ) W B Bean (1953), a thoughtful 
Leser claimed an association oTlh?’ data In 1901, 

condition, with malignant disease 'Les°"?T'’’ ™ observable stan 
'hat 49 of 50 cancer^oatienrs ^ assistant, Muller, found 

senes of 300 noncancer patients , but among a control 

theoretical considerations and especiaUv the”" handful On the basis of 
It appeared most hkely to have bee ^ * '“ability to replicate this result, 
dered, '.Was the wishUeMo the TmT 

or an unbelievably bad observer” (p 24 m T' ° “P" 

0 the work of Feinstein (I960) aL M I ,"1" attention 

former who pomted out the otee^tr I' the 

stethoscope in cardiac diagnostics ’he use of the 

as their stethoscopes be cahbrated Jnh Physicians as well 

who saw a button' ”on a ves^ rlht ” ? 

buttons o^fur 1" T ” >°dgod 

dents observmgquitemaccurately when mes , a '““d "t^dical stu- 
prom%tlo :a;^"Su;"a 

tend to sec thin'gs m suZZ^lltT’' "f 'hat we Tee"®: e w" 
even if this involves distor„o/L''’5 "'dl m in with our ass^^tlons 


: in such a wl 

catcgones “re carefully defined aS^'’b'’* ‘hat^WhTn 
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The Behavioral Sciences 

S»k S*.. !.« -".J «" 

effect on the nocial sc.on^s^oKra^^ mvcsugnlors, he »-as 

chiatiy” m particular ^ er entered into transaction with the 

aware of the extent to which t ^^are- 

obiect of the observation Sulhva , Wirth fl936) and somewhat 

ness, an awareness eloquently expressed 

later by Bakan ( 1962) , Colby ( I ^ viewed appropnately as a data- 

Thepsychotherapyrelatmns p yb hi, 

collecting situation w«h ‘he ‘heraP ^ the evidence 

patient’s responses Both the * P ommpfesent effects of the chnic^ 
of more formal investigauons PO‘'“‘° ,„terMtion are often unobserved 
observer Events occumng in m the chmeal 

or at least unreported by the ^ ^ ^he clinician And often, 

interaction ate sometimes repo personal charactensUcs of the 

the errors may be shown to be " d spots” (Cutler, 1958, 
chmeal °hseiver, particulariy to hi p 1959_ Wal- 

Garfield & Affleck, 1960, Levitt ‘vo 
lach&Strupp, 1960 ,Zirkle, 1959) 

t lonaria Although observer effects may be less 
The observation of planana. & setting, it is nevertheless cleat 

obvious in a laboratory than in a by Cotdaro and Ison 

that they do occur A ^ behavior to be observed was the 

(1963) nicely ''lustrates the fact planana (flatworms 

number of head turns and body worms, seven observers 

placed low on the phylogenetic scale) b contracUng For the 

"were led to expect a very h-gh " g ^ 

remaimng worms the same observed under the two condi- 

dence of turning and contrac g essentially identical Results of this 
tions of expectation were, of course ^^od twice as many 

phase of the experiment s j^ody contractions when their expec- 

head turns and three times as many y expectation was for low 

tation was for high rates of response as wn 

rates of response was repeated employing a new set 

The basic P^“ ^"j^Xer, half the expenmenters were to observe 
of ten observers This time, 



only “high-response-producing” worms, and the remaimng 
given only “low-response-producme” worms Again there v 
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observers were 


given only “low-response-producing” worms Again there was no real dif- 
erence between the two “types” of worms The results of this phase ot the 
expenment found nearly five times as many head turns and twenty times as 
rern^ “"‘ractions repotted by the observers who expected high levels ot 
spending as reported by observers expecting low levL of respLding 

college studemT «ted were undergraduate 

oSrse ■" “ >“‘0^ Psychology course It may be. 

mom expenfn ed oh"' found a^ong 

Kor^bU h ( 9T5I ?nd brCorr"'’‘a''r'’“"‘=‘' 

workers inter^ted inVlamn'?*!"® mdural” mdividual differences among 

experunenters mthe n'^Ier “">“8 ‘h«e 

obtained were for the most Dart sf "“"S’ “"'''aeUon, and other responses 
■962) This experiment diLrert significant (Rosenthal & Halas, 

ways First. “-f f*on in two 

were engaged in “actual ’ research on expectancies but 

Second, all eight of these expenmenters were' m planana 

1“'°“ ™P'oyed by Cordaro and Ison HaU TJ' 'han any 

and the set of eight exnenmAnf niaster’s degrees at the 

tions each At least six of the publica- 

research and four have Ph q V active m psychological 

of diflerenees among 

significant more often than nof were s.a ™cal^ 

ever were subject to surpn^gty^LlHr oontraotiot h^ 

erepancy occurred when one obsOTrer® effects The largest dis- 

rn his companson Z trmes !s m^y 

crp^airobiTr^EXTii r 

complete data were available Th^l “P'"'"=">ers for whomTf 
academically advanced and th " ^^P^nmenters were am^ ^ ^ 

==£SS=5=p£S 

As a control pro- 
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TABLE 1-1 


Two Experiments in the learning of Turning in 
Worms 


First block 
Second block 
Third block 
Fourth block 
Fifth block 
Sixth block 

Means 

p (difference) 


experimenter I 

Experimental 

10.5 
10.0 

11.5 

12.5 

9.0 

8.0 


experimenter II 


10.2 


NS 


Control 

Experimental 

Control 

11.5 

9.0 

8.0 

9.0 

11.0 

11.0 

9.5 

15.0 

10.5 

9.0 

15.5 

11.0 

12.0 

17.0 

11.0 

9.5 

16.0 

11.5 

10.1 

13.9 

.02 

10.5 


. Cix other planaria to which the light was 

cedure, each experimenter had six otn p 

administered without the shock. number of turns for six biocks 

The results of Table 1-1 show to ™"!>^ondi.ioning” of turning 
of 25 trials each. One jl not only obtained more turning 

responses, and one did ^P®" ^.^ntrol group, but his experimental 
in his experimental group than subsequent block. The corre- 

animals showed an increase m turi^g ,94, 

lation (rho) between number of turm p „ununt also showed a 

p = .02. However, the f ""P (jho = 77, p = 10). although 

Ldency to turn more often on later 

the rate of increase was much mor gr contractions. Once again 

Table 1-2 shows to ®"='‘°S°“;^“^\esponses of the experimental and 
there is no difference between the inea P ^ difference 

control groups for “P®""’“ “ ’ ,ions observed for the expenmentid 
between the mean number of planaria in the control 

and control groups by ^'‘P®"'"®" - / ,^6 experimental group. This re- 
group responded more than p surprising as turning an 

tersal of the results of ®>‘P®""’®‘^" '^Wbe so well correlated that toy are 
contracting responses >!®''®‘’f"'°“Cat response” score. 

commonly added together to fom a tLrefore, it can be concluded 

For these experienced expcnm behavior modifi- 

that there are individual difference particular differences found 

cations in planaria observed and tot 

are affected by the specific type o 
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TABLE 1-2 


Two Experiments in the learning of Contraetion in 
Worms 


experimenter I 



Experimental 

Control 

First block 

20 

0.5 

Second block 

05 

1.0 

Third block 

0.0 

0.0 

Fourth block 

1 0 

1 0 

Fifth block 

1.0 

1 5 

Sixth block 

1 0 

20 

Meons 

09 

1.0 

p (difference) 

NS 



EXPERIMENTER U 
Experjnienfaf Confro/ 


0.5 

2.0 

0.0 

0.5 

0,5 

1.0 

05 

2.0 

05 

1.5 

1.0 

2.0 

0 5 

1.5 


.005 


Although the Cotegoing data have been cited as evidence of observer 
effects, alternative explanations are possible It could be that the effects 
arose by chance That does not seem likely, however, since the ammals 
were assigned to experimenters and to expeninental conditions at random 
The likelihood of the experimenter’s effect being due to chance is given by 
the p values of Tables 1-1 and 1-2, and these p values are low It could 
also be that the planana behavior was correctly observed but incorrectly re- 
corded Recording errors of such magnitude, however, are too rare to serve 
as bkely explanations, as will be shown m the next section of this chapter 
Intentional errors arc generally only a remote possibility and, on the basis 
of personal acquaintance, for these particular expenmenters, a virtual im- 
possibility One remaining possibility is that in some way the experimenter’ 
behavior affected the behavior of the planana This can be only a specula- 
tion, but It seems at least possible that one or the other of the two experi- 
menters unintentionally treated his animals differentially as a function of 
whether they were in the treatment or control group It cannot be assumed 
that expenmenter 11 showed such a difference while experimenter I did not 
It could as well be argued that, except for the programmed differences in 
treatment, expenmenter II treated his animals identically and that the dif- 
ferences he (Stained arc those atmbutable only to the expenmental condi- 
tions Differential behavior toward the ammals of the two groups of 
expenmenter I might have “improperly” reduced the “true” difference be- 
tween the expenmental and control animals 

Research with rabbits, as with planana, has shown significant effects 



11 


The Experinicntcr as Observer 

associated with the particular expa«r StwK 

found that inexperienced ain, was to elicit an avoid- 

condition rabbits. As in the pianana an electric shock. Unlike 

ance reaction to hght which had bee" F-djA affect 

the situation for the ^ of the inexperienced experi- 

disappeared xvith further ^^^P the case of the pianana 

menters. Neither in the case of -^-nters did differently that could 

can it be specified just what a later chapter 

have led to such different “"Iws^ 

(Chapter 8) there will be occasion to discuss this pro g 

Recording errors. As 

subjects, their observations ' have been demonstrated and that these 

surprise that errors of recor 8 self-canceling set of errors is one 

errors are not always self-canceling. deflating 

in which errors inflating a aategh^ turmng of worms records three turns 
that category. If an turns that did occur, he has 

that did not occur and fads to . bother out. 

committed six errors which ^ 

Kennedy and Uphoff (1939) F j qj,. Briefly, the task for the 
errors in experiments in s “ 

observers was to record . ^ugg^ver The symbols employed were 

symbol being “transmitted by included circles, squares, stars, 

the standard ones used in 25 cards, five of each of the 

crosses, and wavy lines Each trial observers had been prede- 

five symbols Because the guesses j^^her of recordmg errors 

temuned, it was possible to cou 11,125 guesses, o 

A total of 28 observers All observers made at least 

which 126, or 1 13 percent, ,he modal number of errors per 

one error (one observer committed increased the 'elepathy 

observer was four Some of the err ^ creent), and some had no 

scores (45 2 percent), some deer ^ „neral tendency to make record- 

effect (33 4 percent) There «=* ’ ’ Kennedy and Uphoff knew 

mg errors that mcreased ‘be Jelep J ^^tjasensory perception and 

which observers had ‘“vorable attitudes ^ „d 

which had unfavorable tended to err in the direction 

disbelievers showed that each EP errors were quite small 

favorable to his attitude, though increasing telepathy 

hevers in telepathy made ^ pe^e" jOO percent more errors 

scores than did disbelievers D3;d believers . ^ r 

decreasing the telepathy scores th ^^d by Sheffield and Kaufman 

Very similar findings have b«" ^P fi,„ed the actual fall of 

(1952) ^In an experiment m fljence They found subjects be- 

the dice which subjects were trying 
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Iievmg m the phenomenon to make more tallying errors in favor of the 
hypothesis Subjects who disbelieved made more of the opposite type of 
tallying error 

Recording, as well as computational, errors by experimenters have also 
been studied in an expenment on the percepbon of people (Rosenthal, Fned- 
Ssu?^T"’ ? ' 156'') 1 “ expenment, 

tions as did Kennedy only one fourth as many observa- 

recording errors whatever ° ^ “'’servers, 18 expenmenters made no 

obtain high ratmTof the Dhoto*’s^f " 'hot they would 

menters had been given the onno'^T whereas some expen- 

■nonters who made® any recoS '»'= 4 ®' 

ettpectation, and their errors tended tote Targm (p’l '05 
The computational task tor a. ® ~ “ 6 ) 

discussion was simply to sum the 20 *0 study under 

subjects Of the 30 experimenter 18 m a *’>’ ‘beir five 
of these erred in the direction of their J f “” 2 “'“"““' error, and 12 
were more hkely to make computationaT^”™ expenmenters who 

bypomesis also tended to makeTme Z T" ‘''^““on of their 

In this same expenment all f . "'Putntional enors 
variable of “honesty" dunng’ the coteuct'Ti''""" “P=™enters on the 
bew ^'"8 "uee the expem^' expenment This was a 

been dishonest” even if they had been^„ uctually have 

the co-mvesugators had all exocnm . °“"ng the expeLent 

apparent to all expenmenters) TsproMU *'’™iUance'^ (a “ 0 ^ 

>««.«.( " ■" P”»»- B Bl,. „ 

of 48 (p - nn n ^ occurrence of computationalT “ “currence of 
(P - 01 ) Showed that expenmen.e^ who ere'dTd 

eered i„ data transcnption 
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,0 » I. a- "■ 

experimenters who erred in t e _ qj^ ,o in the same 

cording errors were not any more of numerical errors 

direction in their computationa cr ' . . j directionality of error 

seemed, then, to be a consistent eharaetenst.e, but 

vis-a-vis expectation did not. effects of both recording and 

We should note h=r= that thej^e" 
computational errors on the g neplieible An occasional expen- 

tions of the experiment reported "'"^^^Srobtained; an effect that, 
menter did have some real e ec entire experiment depended on 

at least in principle, could be ‘'“" eaUy. 

an experimenter who was prone to e experimenters 

In a recent experiment ‘ person perception employing a 

conducted the same basic expenm ^ jimenters made computa- 

total of 64 subjects. In this study, ^ fer, 6 percent of his compu- 

tional errors. For the most accurate «P ^^22 and 26 percent of 

rations were in error. The other expenmem^^ ^e 

the time. The magnitudes ° ‘h® of the errors tended to 

experimenters, a majority (7 P , j, ,),£ frequency of these biase 
fav^or the experimental hypo^esis, g ^ apparent regu- 

errors did not reach statistical ' „,„^ion has been given to rwl 

larity of the occurrence of e^fogmrature of psychology (Hanley 
or aUeged numerical errors in the scientinc 
&Rokeach, 1956 ; Wolins, 1962). 


CONCEVrUALIZATlON OF O.^R™ 

In the mapping out of the g;""'‘“7/dBSations must now 

only broad hints at certain ° these mattem 

be made more expUcit. Later on, in Part u,e have re- 
in greater detail. By “observer ^ some "herion value, men 

ferred to overstatement or ‘ ,m„, each may be said to e 

two observers disagree m an err with respect to some tlnrd ob 

respect to the other. Both may ^ ^e a more or less usefuUy ^ 

serration which may, for vanous ^ observations, we "ay cli^se ‘o 
ployed criterion. Given a P°P"’f ‘""/^ean or mode) as the true vdue 
Lfine some central value (*“* “ f " that value as being more or less 
and regard all observations "bt Mlmg .ontral value _ 

in error as a direct function of ‘hair * .^bed from observer b as 

Observer errors or effects "-f^^^tly distributed around a “true o 

by the fact that observer errors are «nd° y^^ high or 

“criterion” value. Biased observations 
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too low and may bear some relation to some charactenstics ot the observer 
(Roe, 1961 ), the observation situation (Pearson, 1902), or both 

In considering the act or seqnence ot acts constituting the observation 
m the scientific enterprise, we may distinguish conceptually among locabons 
of error or bias The error of “apprehending” occurs when there is some 
evl C f “‘J *e observer of the 

rdTtfenn„rV ; apprehending error 

Georar^rt'™' !r obsefvation 

yser’coruca ' “> '>«= »PParatus, central relay 

be diTtmlTshed r,w "^“^^ing may 
recolT*r!ra?ur^ apprehending error In the cL of 

by a transcription of the event fin apprehending followed 

or to another instrumcnfi i, , . ^ar of another observer, 

headed In acmal pmcl^ ^PP- 

recorded in error wnh respect to soi^^cT^^" ” observaUon is 

as having occurred either m aonrehend '“ate the error 

esses There is no certain meihna t '"®’ h^anscnbmg, or in both proc- 
unconfounded with a recording error°\ho°'^h'’® apprehending error 
be suggestive ® “ > though introspective reports may 

going orrors“siwe\h"yTnvoIvr°he'i'“''^ distinguishable from the fore- 
ovents '"correctness IS usually defined recorded 

■cal operations by the formal rules of anthmet 

In some of the case< nf “«k 
of the observation is so vague and ephem^f h"’" 
of errors of apprehending^ or recordinn fn properly speak 

he case, for example, wift psXtec “"’P'"^"™) Stich would be 
Ins ..nation we may more'apprLpLt 'f -r “ours 

"on r"'7^'‘“"0"cftectswillbedTscussed^ ■"terpreta- 


I emng 


tiie control of observer ertkct 

pli?S|ss-i~ 

-~"~-S=5;== 
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sion and rerecording. If mechanization reduces observer error — and it very 
likely does— there remain still subsequent errors of “re”-observation. Yule 
(1927) was relatively optimistic that observer training could eliminate ob- 
server error. This optimism seemed unshared by Fisher (1936) in citing 
Rasmussen. 

The most critical control of observer error is probably woven into the 
fabric of science by the tradition of replication. Frequent replication of 
observations serves to establish the definition of observer errors. It does not, 
however, eliminate the problem, since replicated observations made under 
similar conditions of anticipation, instrumentation, and psychological cli- 
mate may, by virtue of their intercorrelalion, all be in error with respect to 
some external criterion (Pearson, 1902). An excellent example of this, as 
mentioned, is Rostand’s (1960) discussion of the infamous N-rays. Per- 
haps the great contribution of the skeptic, the disbeliever, in any given 
scientific observation is the likelihood that his anticipation, psychological 
climate, and even instrumentation may differ enough so that liis observa- 
tion will be more an independent one. Error, in the sense of discrepancy, 
will then have a greater chance of being revealed. Which of two con- 
tradictory sets of observations will be regarded as error-free depends on 
sets of criteria subsequently adopted by the assessing community. 



2 


Interpretation of Data 


scienhtTin'^ differently by different 

nH Luon T ™P'-“''ons are the subject of this chapter. 

tatior-?^e diRerl"'" ™P'y defined as any difference in mte^re- 
.nZret« Ld!u hT mterpreters, oVan 

“accepted" interpretation o? interpreter as an established theory or an 
serverSffectStmreier As in the ob- 

a umdirecuonal phenomenon wk does not necessanly imply 

utcd around a true value we ref are nonrandomly distrib- 

■larly, when intOr^rlt uo’nrH “ observations ” Sim- 

not— we may refer to them as^'h"* ” 7 . usually they do 

that the biased interpreter “w thereby imply 

.merpretation.” Ent .hat T™® '{ “true 

seem as reasonable to postulate th' "’’Of “™ P‘'=dictable It does not 
interpretation as it doe^s to postulateTh “‘orpretation as the true 

true observation ^ central value observation as the 

The disunction between an nh^ 

an observation is not always simnT«» the interpretation of 

component of interpretation than mh a greater 

«orms there seems to be iL 101^?, “ th= behavtor of 

there is a worm present than to obsc^n to observe whether 

mobile If we choose to obsei^ ‘'''= ^ “”P>=‘->y ™- 

servation of its presence or absent m ^ even the ob- 

a larger interpretive 

Interpretations or constructions of dnt^ u 
generality, from the interpretation of t enormous range of 

•bmugh the interpretation of a perso„-n sS' u 
K izophrcnic, to the interpretation of measLrTm '^'^bizophremc or not 

as damagmg to or irrelevant to Einste.n-s theory of re, atiwy' speed of light 


IS 
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At the lowest level of generahty, differences in interpretation could 
easily L regS as observer effect! At the highest level of gener^^ 

ires HHS'sr rsst ::: 

plied by some of the evidence presented in I960; see also 

tensive literature on need-determine P®‘^“P 1928). Second, 

Campbell, 1958; Sanford, 1^36; Stephe^. ^ 

a given theory Such^underrepresentation of 

that may weaken the tenability of th ^ ^ “true” value of an 

data contradictory to prevailing t ^ ,ion ^as defined in terms 

observation. Since the “true” value of an °“ery“ by 

of some central value of ® ^^isting central value that value 

ignoring bie smtisticaUy and psychologically, 

will become more and more stable , of a dominant theory have 

If in the history of science tte^ 
often thus shepherded the current responsible for the 

tion supporting their ‘heory, they ave jbeoretical biases are mixed 
fact that observations were being m completely unbiased 

blessings. They are selectively attentive to data that if co p 
by theory would not have been collected at aU. 


The Physical Sciences 

In 1887 Michelson and Morley the°light !gnals were 

the speed of light. Their roP°rt ®howe ^ ^as the 

sent out m the direction of th (he stimulus for Em- 

same. It is said that this oounterintuitiye Michelson-Morley cx- 

stein to develop his theory of rclaby-ty ' ^^905-^ ,he result 

periment was important to r y ^ be added. First, 

Lemed required by it. B“^here are^wo , 

according to Einstein, the Mic . ,h!oiy. Second, the results of the 

with his original formulation o r ^ . jj, jrror, and there did appear 
Michelson-Morley f’‘P'P^r"irbv a difference in the speed of light as a 
to be an “ether drift. Define y Ih^ earth’s motion, this ether 

function of the signal’s direction i ,hcorv That it did not illustrates 

drift” could have jeopardized rclali y 

interpreter effects in science. Kocsller (1954) have given the 

Michael Polanyi (1958) SUn-Morley experiment, 

details. In 1902, some 15 years al 
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W M Hicks showed some ether dnft in their onginal observations Then, 
from 1902 to 1926, D C Miller repeated the expenment with improved 
instrumentation thousands of times and consistently obtained a dnft of 
from eight to mne kilometers per second Still later, W Kantor, using 
still more elegant instrumentation, also showed that the speed of hght did 
depend on the motion of the observer So weU established was relativity 
theory that Miller’s work was essentially ignored (though that was difficult, 
since he presented his complete evidence m 1925 to the American Physical 
Society, of which he was then president) It is true, as Polany. teUs us, that 
dnf?.™' workers for the absence of ether 

b"e„ maklr'^;;'''' "-“y before that he had 

arartd c ?n M,n ■*“ *■= '^’’cthcr there reaUy was 

posrbiffiv tha^"!” r ’ “> I* ‘here a 

data senously, might'’brcause of thes'’^“ ^PP^onUy sound 

relativity theory tha ’u would h data, have so modified 

•hey are%nsw mhk a'aTl E r r" P"""'*” *>“=» 

Mtller’s Sa were Ignored b„TZr“ 
effects Of interpretation o/dataarP«.*h ^ Sometimes the 

Bernard Barber (1961) tells of som unavailable 

Lord Kelvin’s tmerpreLVofof Roelr^ O"^ 

phenomenon in reverse Several insif " * ^ ^ '^"d of N-ray 

papers that seemed to the ludces to b» °! '^"’•ers’ inability to publish 
The most interesting of these because were also documented 

Periment, was the case of l’ d ''fP/““‘* •> hmd of controlled ex- 
cm,tlcd’.AnE,per,me„tl"s^^ he submitted a paper 


^imiiQ An Expenment to Show The. rs ' submitted a paper 
Greater in Both Branches than ,n M ‘u"' Current May Be 

well-known In . Mams " He was m m. . 


well-known In some way' '"e time, alrLdy 

ever, and it was rejected Shortly afterw^ *be paper, how- 

“r p- - r; 

he first pubMhe°d" h?s?hro™L°iS,'„™e°''‘’' "P“' ™yh'l963^''l‘ m4 
c F«nmcn.al evidence on its bchaK Bu convincing 
ThT ^ '■is theoo- unacceotlm eonception of 

pnbhclj, Polanyi was chastised by EinsLm f' "“>te his position 

°f what was then ’known” abom ,rstn.c‘;”^°“”S “ "'otal disregard” 
lOIi rr,!'?: ‘be occasion only b^ikn P^'^y- 


occasion only by the skm ^ f - ' 

ns ...1 y •oe skin of my teeth” (p 


lOIl) Polanyi. of course wns ...k ‘"= skin 

”7" 7' “"=■'>''^ 01 'he role of, ha, Thod^ »“h 'ha™g' be™ 

idence from being considered ,s romarkabt fo;"it?'hT b'^ 

•ts balance, objectivity, 
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and the lack of bitterness, a bitterness that characterized Planck’s reaction 

to the resistance he encountered (Barber, 1961). 

Polanyi felt that the rejection of his theory and his evidence un- 
avoidable and even proper given the state of know e ge a ^ . 

though recognizing the danger of orthodoxy in repressing ^ 

evidface, he poinU out that the journals could 

nonsense in the faee of a too great tolerance of dissen . Znaniecki in 

ol orthodoxy is much the same as that e.xpressed y ° 
his classic work, T/ie Social Role of the Man of now e g 

The Biological Sciences 

• Hata are not 

Mosteller put it well, - ■ perhaps at all noticed, 

ready to be looked at — and it is not that the anoma i ^j^^t to 

but that they aren’t discussed much because no on ^ reason why 

say” (personal communication, 1964). Per . rj^^jj-idization, 
Mendel’*' F.xneriments in riant 


at iney areni aiscus^cu . reason wuj 

^personal communication, 1964). Per ,^^yijj.idization, 
d’s now classic monograph. Experiments m Correns, 

presented in 1865, had to wait to become 1™?“’“ i„aependently of each 
and Tschermak found something to say about i , Mendel’s 

other, and all in 1900. Perhaps, too, less was lou -j^eniatics to bot- 
work because of his, for that time odd, j.-tific stature (Barber, 

any, and because of Mendel’s relative lack o ^ j^gs data, however, 
1961). Even after people found things to say a o interpret in 

ao one looked at it closely enough because i ,jp„ Fisher (1936) 

accordance with each one’s own 11’®'”’®*'!^“*’ .,„4eVs paper only what i 
put it; “Each generation, perhaps, found in ignored what did no 

expected to find; . . . Each generation, thereior , b 
confirm its own expectations” (p. 137)- biology- Darwin, Lister, 

Mendel’s case is not unique in the j^d to be ignored or r 

Pasteur, Semmelweiss, and their cases. They and ote . 

jficted, and these are only some of the better-known ca ^ (j960), 

'ess well known, -n-nicled by Barber tiv 

Koestler ' 


veiss, and their o'’=’ei''““''“- ases.Tneya..- — - 

are only some of the better-knownc^^^^^^ (I960), 

well known, have been chronicled y 
stler (1964), and Zirkle (I960.) _ is too 

Sometimes in science the situation is ^ number of eq 

be said about the data but neither to 

isible interpretations are available, an assimilation o 

ervations nor to ignoring * 0 ™. « '“d ^ Wo'f ^ 

be various theoretical positions that can found 

- ns a good example based on Morns^ d,s«_^ 
hway motormen with a higher incid P“XP“^’ ?,hesc data 

n tramway conductors. (The data m y, • ,g,pretation o ^ 

'eee from" observer effect.) The occupations 

' in terms of the relationship between ^f^ent ,^0 conducto 

ease, the motorman sitting while performi g 
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ing about more One alternative interpretation offered by Wolf was that 
motormen, because of their sedentary work, might be gaining weight 
faster and that it was the weight gam which led to a higher incidence of 
heart disease Wolf presented the additional interpretation that the lessened 
social interaction with other people required by the motorman’s ]ob when 
compared to the conductor’s job might also be the critical variable Other 
interpretations are of course possible, including those which postulate that 
mdmduals prone to heart disease, because of their biologtcal or psychologi- 
make-up, tend to select or be assigned to the front end of the trolley 
Here, then, are alternative interpretations whose relative tenabihties could 
easily be established by further observahon The initial data were im- 
mediately important theoretically (and practically) because there were 
teted fuX h of «>" observations and could be 

Thu Bchatioml Sciences 

that there were no obsereM'errore Wbr"""’ 

conductor seemed an easy observ-u i ntotorman and who is a 

The presence or absence o^tard:rase°\r^'’ consensus 

cquuocal judgment (Feinstein, 1960)“% meT rt’ ” ^ '"0^‘ 

d'agnostician dilTercnces are obse™ Z ^ P"‘ ^^^ide whether 

"c may assume that cardiologists hear'the'"’ effects If 

atethoscopes and seethe same Uaeinps .1 T' ‘hstr 

be inclined to regard diagnostic variaLns 

In the applied behavioral sciences of of interpretation 

the diagnosis or catcgonzation of h '“"'f ehnical psychol- 

Didercnccs in the interpreL.on „f behavm“T; ” “ 

AITcrcnces in diagnoses The magnitud^e of ‘"“strated by 

potted b, Star (1950) During .ht f ‘‘‘fences have been rc- 

cxnm,„e„ second World War, psychiatric 

"ho might be too severely disturbed Inf, P“tpose of rejecting any 
t^c dillcrcnce in rate of rejection founrone" 

fetcnccT^nruarry^emhtr^^^^^^^ 

urcpLVabVdTwm^'stn:™'^ large eOcets of m.erppeters 

tons diagnostic calegories Of itself this wo„ "f the var- 


"ould increase unrehabihty lUh,l 
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source of unreliability were the only one, however, we would expect 
interpreter differences to be unbiased or unpredictable. But that is not the 
case. Robinson and Cohen (1954), for example, found that there were 
significant biases in the psychological evaluations of 30 patients by 3 
psychological examinere. The authors related the biases in evaluation to the 
personality differences among the examiners, a relationship postulated by 
Henry Murray in 1937 and supported in a number of studies (e.g., Filer, 
1952; Harari & Chwast, 1959; Rotter & lessor, undated). In this dis- 
cussion of interpreter effects among diagnosticians we have assumed that 
the examinee’s behavior on which the interpretations were based was not 
itself affected by the examiner. Sometimes the examiner does affect the 
patient’s behavior and markedly so. These effects will be discussed begin- 
ning with Chapter 4. 

Before leaving the area of clinical diagnosis or interpretation it should 
be emphasized that diagnostic differences occur in other areas, perhaps even 
to as great an extent. Jones (1938), for example, has shown the degree 
of disagreement in the assessment of the nutritional health of school- 
children. Not only did diagnosticians disagree with one another, but they 
also differed from their own earlier assessments. 

Sometimes in nutritional diagnosis, as in psychological diagnosis, 
we can speak of biased or directional or predictable differences among 
diagnosticians (Bean, 1948; Bean, 1959). An informal report by Wooster 
(1959) nicely illustrates such biased diagnosis. Wooster tells the possibly 
apocryphal story of 200 patients who were to be classified as obese, normal, 
or underweight. Leaner physicians tended to classify patients as more 
obese than did obese physicians. 

One variable that has been shown especially likely to bias the assess- 
ment of behavior is the expectancy of the observer or interpreter. Rapp 
(1965) tells us about an especially carefully conducted experiment which 
demonstrates this expectancy bias. Rapp’s experiment, it will be seen, 
could be equally well viewed as a study of observer effect or of inteqjreter 
effect. It deals with data falling in the range of experimenter effects that 
are difficult to categorize clearly. 

The setting of the experiment was a nursery school, and the task 
for each of eight pairs of observers was to describe objectively the be- 
havior of a single child as it occurred within one minute. One member of 
each pair of observers was led to believe that the child to be observed 
was feeling “under par.” The other member of the pair of recorders was 
led to believe that the child was feeling “above par.” Actually all the eight 
children included for observation had been selected so that their behavior 
would not show extreme behavior in either the above or below par 
direction. Results of this study showed that seven of the eight pairs 
of obscr\’crs wrote descriptions of the children’s behavior that were dctcct- 
ably biased in the direction of their expectation (p = .003). 
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An example of the bms.ng effect of expectations, “ 

be more dearly an example of an rnterpreter effect, ts given bj Cahen 
(1965) His subjects, 256 prospective schoolteachers, were each a 
I score several test booklets ostensibly filled out by children being tested 
for academic readiness Each of the 30 test items was to be scored on a 
four-point scale using a scoring manual which gave examples of ansvyers ot 
varying Quahty On each of the answer booklets to be scored some back- 
ground’ informaUon was provided tor that child This background in- 
formation included an alleged IQ score, the purpose of which was to 
create an expectation m the scoter that the child whose booklet was being 
scored was (1) above average, (2) average, or (3) below average in 
intellectual ability The sconng of the tests supported Cahen’s hypothesis 
that children thought to be brighter would receive higher scores for the 
same performance than would children beheved to be less able 

The assessment of cultures like the assessment of individuals is 
subject to widely divergent interpretations (Hyman et al , 1954) Oscar 
Lewis and Robert Redfleld desenbed the Mexican village of Tepoztlan 
m quite different ways Redfleld presented a picture of a highly cooperative, 
integrated, and happy society relative to Lewis’ picture of an uncooperative, 
poorly integrated society whose members seemed anything but happy Reo 
Fortune and Margaret Mead desenbed the Arapesh m significantly different 
terms For Mead, but not for Fortune, the Arapesh were a placid, domestic 


people charactenzed by a maternal temperament 

In such cases of anthropological disagreement we are hard put to 
account adequately for differing interpretations It is important to know 
that such differences occur, but it would be most valuable to know why 


If, for example, we could show a general tendency for female workers to 
perceive cultures as more peaceful, we could begin to wnte some general 
terms into the anthropological personal equations In the absence of such 
data wc arc left with the unsatisfactory alternative of noting differences 
Without adequately understanding them 

Sometimes an anthropological interpretive effect can be understood 
as an illustration of a well known principle of perception Such seems to 
be the case for data cited by Campbell (1959) The evaluation of the 
drabness or liveliness of Russian cities was found to depend on the order 
in which the cities were visited Cities visited earlier on a lour were judged 
more drab than those visited later “Against the adaptation level based upon 
experience with familiar U S cities, the first Russian city seemed drab 
and cold indeed But stay m Russia modified the adaptaUon level, changed 
the implicit standard of reference so that the second city was judged 
against a more lenient standard’ (1959, p 11) (Here and elsewhere 
(19581 Campbell has provided invcnlones of sources of error relevant to 
our discussion of interpreter as well as observer effects ) 
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A major attempt to assess the biasing eifects of different anthropologi- 
cal interpreters has been made by Raoul NaroU (1962), His method of data 
quality control is designed to compare anthropological reports made under 
more favorable conditions with reports made under less favorable condi- 
tions. Thus, staying in the field for over a year is associated with reports of 
higher rates of witchcraft attribution than staying in the field for less 
than a full year. Length of stay in the field is, then, a biasing factor but 
one for which it seems reasonable to assume that the longer stay gives 
a truer picture than does the shorter stay. Length of stay in a culture 
does not, however, bias reports of drunken brawling, so we see th^t 
conditions of observation or interpretation may bias reports of some 
behaviors but not others. 

Another test of the quality of anthropological reports notes the 
investigator’s knowledge of the native language. Whether he knows the 
language tends in fact to be related to his report, not only of witchcraft 
attribution, but of protest suicide as well. A third test described by Narofi 
is the distinction between a professional and nonprofessional investigator. 
The anthropologist is the former, and, in this context, the missionary the 
latter. Although in general we might expect professionals to be more 
accurate, Naroll suspects that, at least for reports of witchcraft attribution, 
missionaries may be more reliable than anthropologists. In summary, 
Naroll’s method allows us not only to assess the extent of bias in a series 
of anthropological reports but to institute controls for these as well. 

Perhaps more than any other, the survey research literature ha^ 
shown a sophisticated awareness of interpreter and related effects; th^ 
alread/ clxLS.ric work of Hjwnan and his collaborators (1954) shows thi$ 
fact most clearly. In their discussion of interviewer effects they describe 
the impact of interviewers’ expectations on their interpretation of respond-, 
ents’ replies. Smith and Hyman (1950) provide the example. Recordings 
were made of two interviews. One of the respondents was a political isola- 
tionist described additionally as provincial and prejudiced. The other 
respondent, chosen to contrast markedly with the first, was an interven- 
tionist. In each interview, responses were included that objectively reflected 
equivalent sentiments on the part of both respondents. However, the 
interviewers were greatly affected by the respondent’s overall orientation 
in assessing these matched replies. One of the questions dealt with the 
amount of money spent by the United States for European recovery. 
Answers to this question by the isolationist and interventionist both actually 
suggested that we were spending an appropriate amount. However, when 
these same answers were coded or interpreted by interviewers who hod 
been given the isolationist vs. interventionist set, the results were dra- 
matically altered. The isolationisrs response was interpreted as meaning 
that wc were spending too much for European recover)' by 53 percent of 
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the interpreters The interventionist’s response, which had been equated 
with the isolationist’s response, was interpreted as meaning that we were 
spending too much by only 9 percent of the interpreters 

Another question on which the replies of the two respondents had 
been equated dealt with the respondents’ interest in our policy toward 
Spam Actually both respondents’ replies indicated some mterest, and 
99 percent of the interpreters so coded the interventiomst’s reply In con- 
trast, however, only 76 percent of the coders so interpreted the isolatiomst’s 
reply 


For our most recent examples of interpreter effects we turn to 
experimental research in psychology A recent paper summarizes 25 
experiments in which eyelid conditioning was related to the subjects’ 
level of anxiety as measured by a paper and pencil test (Spence, 1964) 
Considerable theoretical importance is associated with the direction of 
this relationship, the more highly anxious subjects having been postulated 
to show the greater learning In 21 of the 25 experiments the greater 
earning did in fact occur (p = 002) among the more anxious subjects, 
though the differences were not statistically sigmficant for every individual 
comparison The interpretive effects anse from the finding that 16 of the 
f » laboratory showed the predrcted effect 

Vo,"'!’')' '^"atones 5 out of 8 studies showed the 

Lmohnc could ^ ^ differences in procedure and in 

miemrctation nir* aecount for these differences One major 

the Ttudie uo^ co'h 'ha differences, however, was that 

an imemretatl wo 1 ? “i sizes Such 

of c increase “ '“"“'"’a"' 'ba fact that the power 

!hrL of the ht S "n ' “"’P'' '' " 'ha 'ha' 

the unpredic.ed®direction'7nTs cteThe'”?''’ 

sample sire would lead in urr ' interpretation that a larger 

onl/be made If It astL hriT """ 

from carlicr-run subiects and ^ er-run subjects differ significantly 

An axample^f a^Cr^tarmf'' P-i-'a-' direction' 

that If the eight csperimcnts'eonducted at’ddf'"'"”! 
plojcd larger sample sizes their results^ would^r" n‘‘^°'‘““‘"'' ''“d 
more dillerent from the Iowa studies than ®‘g"‘hcantly 

reeen. examples of in.erprc.er dinert«s “v be^'f O'"" 

extrasensor) perception (Bonne 1962h u ^ discussions of 

psjcholog) (Chapa^s&Chapan^is >P“) '‘"d o' social 

Wcick 1965) ^ 1564, Silverman, 1964, 

Earlier in the discussion of the natur-ii c,.. 

■O the fact iha, sometimes m.erpreterrffer ""-d^ 

off ihe marhel” This, of course, also occurs in the hnU T'"® 
Sometimes i. occurs dirccllj, as i„ an explicit or implc7 ed^mna, rc^n 
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to not publish certain kinds of experiments Such decisions, of course, are 
inevitable given that the demand for space in scientific hterature far exceeds 
the supply Often the data thus kept off the market are negative results 
which are themselves often difficult to account for (The problem of 
negative results will be discussed m greater detail in Part III ) 

One good reason for keeping certain data off the market is that 
the particular data may be wrong This suspicion may be raised about a 
particular observation within a series that is very much out of line with 
all the others But the question of how to deal with such discordant data 
IS not easily answered (Rider, 1933, Tukey, 1965) Kety’s (1959) caution 
IS most appropnate *' it is difficult to avoid the subconscious tendency 
to reject for good reason data which weaken an hypothesis while un- 
critically accepting those data which strengthen it” (p 1529) Wilson 
(1952) and Wood (1962) give similar warnings 

THE CONTROL OF INTERPRETER EFFECTS 

Some interpreter effects are fully pubhc events and some are not 
If the interpretation of a set of public observations is uncongenial to 
our own orientation we are free to disagree The pubhc nature of these 
interpretive differences insures that in time they may be resolved by the 
addition of relevant observations or the development of new mental 
matrices which allow the reconciliation of heretofore opposing theoretical 
orientations (Koestler, 1964) 

When interpreter effects operate to keep observations off the market, 
however, they are less than fully public events If an investigator simply 
scraps one of his observations as having been made in error there is no 
one to disagree and attempt to use the discordancy in a reformulation of an 
existing theory or as evidence against its tenability When negative results 
are unpublishable the fact of their negativeness is not a publicly available 
observation When unpopular results are unpublishable they are kept out 
of the public data pool of science All these examples are clcar-cut illustra- 
tions of interpreter effects which reduce the “public-ness” of science There 
are less clear-cut cases, however 

As m Mendel’s case, the observations are sometimes available but 
so little known and so hltle regarded that for practical purposes they 
arc unavailable publicly Sometimes it is our unawareness of their existence 
(hat keeps them out of science, but sometimes they arc known at least to 
some but “ they lie outside of science until someone bnngs them in” 
(Boring, 1962b, p 357) That, of course, is the point made earlier, that 
ssc may know of the existence of data but not wlnt can be said of them 
When we speak, tlicn, of the control of interpreter effects we do not 
ncccssant) mean that (here should be none In the first phcc, their 
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elimination would be as impossible as the elimination of individual dif- 
ferences (Morrow, 1956; Monow, 1957). In the next place their elimina- 
tion would more likely retard than advance the development of science 
(Bean, 1958). 

Only those interpreter effects that serve to keep data from becoming 
publicly available or those that are very dose to being observer effects 
should be controlled. As for the interpreter effects of a public nature that 
involve the impassioned defense of a theory, Turner (1961a) put it thus: 
“In the matter of making discoveries, unconcern is not a promising trait. 
But the desire to gain the truth must be balanced by an equally strong desire 
not to be played false” (p. 585 ) . 
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Intentional error production on the part of the experimenter is prob- 
ably as relatively rare an event in the psychological experiment as it is in 
the sciences generally (Wilson, 1952; Shapiro, 1959; Turner, 1961b). 
Nevertheless, any serious attempt at understanding the social psychology of 
psychological research must consider the occurrence, nature, and control of 
this type of experimenter effect. 


The Physical Sciences 

Blondlot’s N-rays have already been discussed as a fascinating example 
of observer effect. Rostand (I960) has raised the question, however, 
whether their original “discoveiy” might not have been the result of 
overzealousness on the part of one of Blondlot’s research assistants. Were 
that the case then we could learn from this example how observer or 
interpreter effects may derive from intentional error even when the 
observers are not the perpetrators of the intentional error. This certainly 
seemed to be the case with the famous Piltdown man, that peculiar anthro- 
pological find which so puzzled anthropologists until it was discovered 
to be a planted fraud (Beck, 1957). 

A geologist some two centuries ago, Johann Beringer, uncovered some 
remarkable fossils including Hebraic letters. “The[se] letters led him to 
interpret earth forms literally as the elements of a second Divine Book” 
(Williams, 1963, p. 1083). Beringer published his findings and their 
important implications. A short time after the book’s publication a “fossil” 
turned up with his name inscribed upon it. Beringer tried to buy back copies 
of the book which were by now circulating, but the damage to his reputation 
had been done. The standard story had been that it was Beringer’s students 
who had perpetrated the hoax. Now there is evidence that the hoax was no 
schoolboy prank but an effort on the part of two colleagues to discredit him 
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? T-rri', 1963) Here again is a ca«e where interpreter effects oii 
saentist could be in large part attnbuted to the intentional 

srrxcf ciiers , 

i ccrz recent episode m the history of archaeological research, ana 
cnc L: rore difficult to evaluate, has been reported on the pages of 
Tr^SjrJay Observer Professor L R Palmer, a comparative philologist at 
Oxfc'd, has called into quesUon Sir Arthur Evans’ reconstrucUon of the 
CEca'-alions at Knossos (Crete) These reconstructions were reported in 
190^ and then again m 1921 The succession of floor levels, each yielding 
fts ovm distinctive type of pottery, was called by Palmer a “complete figment 
cf Evans’ imagination ’’ Palmer’s evidence came from letters that con- 
tradicted Evans’ reconstruction — letters wntten by Evans’ assistant, Duncan 
Mackenzie, who was in charge of the actual on-site digging These letters 
were wntten after Evans had reported his reconstruction to the scientific 
pubhc Evans did not retract his findings but rather in 1921 he reissued his 
earlier (1904) drawing Palmer felt that the impbcations of these events 
for out understanding of Greece, Europe, and the Near East were “incal- 
culable” (Palmer, 1962) In subsequent issues of The Observer Evans 
had his defenders Most archaeologists (e g , Boardman, Hood) felt that 
Palmer had little reason to attack Evans’ character and question his motives, 
though, it they are right, questions about Duncan Mackenzie’s might be 
implied The Knossos affair serves as a good example of a possible inten- 
tional error which could conceivably turn out to have been simply an 
interpreter effect— a difference between an investigator and his assistant 
One thing is clear, however whatever did happen those several decades 
ago, the current debate in The Observer clearly illustrates interpreter dif- 
ferences 


C P Snow, scientist and best-sclling novelist, has a high opinion of 
the average sciemisfs integrity (1961) Yet he refers to at least those few 
cases known to scientists in which, for example, data for the doctoral disser- 
tation were fabricated In one of his novels. The ASair, he deals extensively 
with the scientific, social, and personal consequences of an intentional error 
in scientific research (1960) Other references to intentional error all some- 
what more pessimistic m tone,ihan was C P Snow, have been made bv 
Beck (1957), George, (193?*^ Noltingk (1959) ^ 
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that Leser’s assistant may have tried too hard to present him with nearly 
perfect correlations between harmless skin markings and cancer; (3) 
Binet’s suspicion over his own assistant’s erring so regularly in the desired 
direction in the taking of cephalometric measurements (Wolf, 1961). 

One of the best known and one of the roost tragic cases in the history 
of intentional error in the biological sciences is the Kammerer case, 
Kammerer was engaged in experiments on the inheritance of acquired 
characteristics in the toad. The characteristic acquired was a black thumb 
pad, and it was reported that the offspring also showed a black thumb pad. 
Here was apparent evidence for the Lamarckian hypothesis. A suspicious 
investigator gained access to one of the specimens, and it was shown that 
the thumb pad of the offspring toad had been blackened, not by the 
inherited pigment, but by India ink (MacDougall, 1940). There cannot, 
of course, be any question in this case that an intentional error had been 
perpetrated, and Kammerer recognized that prior to his suicide. To this 
day, however, it cannot be said with certainty that the intentional error was 
of his own doing or that of an assistant. A good illustration of the opera- 
tion of interpreter effects is provided by Zirkle (1954) who noted that 
scientists were still citing Kammerer’s data, and in reputable journals, 
without mentioning its fraudulent basis. More recently, two cases of pos- 
sible data fabrication in the biological sciences came to light. One case 
ended in a public expose before the scientific community (Editorial Board, 
1961); the other ended in an indictment by an agency of the federal 
government (Editorial Board, 1964). 

The Behavioral Sciences 

The problem of the intentional error in the behavioral sciences may 
not differ from the problem in the sciences generally. It has been said, 
however, that at least in the physical sciences, error of either intentional 
or unintentional origin is more quickly checked by replication. In the 
behavioral sciences replication leads so often to uninterpretable differences 
in data obtained that it seems difficult to establish whether “error” has 
occurred at all, or whether the condiUons of the experiment differed suffi- 
ciently by chance to account for the difference in outcome. In the behavioral 
sciences it is difficult to specify as explicitly as in the physical sciences just 
how an experiment should be replicated and how “exact” a replication is 
sufficient. There is the additional problem that replications are carried out 
on a different sample of human or animal subjects which we know may 
differ vary markedly from the original sample of subjects. The steel balls 
rolled down inclined planes to demonstrate the laws of motion are more 
dependably similar to one another than are the human subjects who by their 
verbalizations are to demonstrate the laws of leaming. 

In survey research the “cheater problem” among field interviewers 
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(Jahn & Woolf, 1963) Here again is a case where interpreter effects on 
the part of one scientist could be in large part attributed to the intentional 
error of others 

A more recent episode m the history of archaeological research, and 
one far more difficult to evaluate, has been reported on the pages of 
The Sunday Observer Professor L R Palmer, a comparative philologist at 
Oxford, has called into question Sir Arthur Evans* reconstruction of the 
excavations at Knossos (Crete) These reconstructions were reported in 
1904 and then again in 1921 The succession of floor levels, each yielding 
Its own distinctive type of pottery, was called by Palmer a “complete figment 
of Evans’ imagination ” Palmer’s evidence came from letters that con- 


tradicted Evans’ reconstruction — letters wntten by Evans’ assistant, Duncan 
Mackenzie, who was in charge of the actual on-site digging These letters 
were wntten after Evans had reported his reconstruction to the scientific 
pubhc Evans did not retract his findings but rather in 1921 he reissued his 
earlier (1904) drawing Palmer felt that the implications of these events 
for our understanding of Greece, Europe, and the Near East were “meal- 
culable” (Palmer, 1962) In subsequent issues of The Observer Evans 
had his defenders Most archaeologists (eg, Boardman, Hood) felt that 
t^.!*** * f* 2 son to attack Evans’ character and question his motives, 
imiuf.H Tk % about Duncan Mackenzie’s might be 
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perienced interviewers to deal with. However, even if these factors increased 
the incidence of intentional error production by 400 percent, enough re- 
mains to make intentional erring a fairly serious problem *e su^ey 
researcher (Cahalan, Tamulonis, & Vemer, 1947; Crespi, 1945^6; Ma- 

halanobis, 1946). . _ 

A situation somewhere between that of collecting data as part of a 
part-time job and collecting data for scientific purposes exists in those under- 
graduate science courses in which students conduct laboratory exerases 
These students have usually not yet identified to a great 
scientific values of their instructors, nor < 5 ° their 

work as simply a way to earn extra money. Data fabncation in these cir 
cumstances fs commLplace and well-known to “ 

physics and psychology alike. Students’ motivation for “g ^ ° 

LLe, to hoax their instructors or to earn more " 

rather to hand in a “better report,” where better is defined ■“ 

;rnS c“::r« “d 

is reminded of the Berkson, Magath, and Hu™ 1940) fin^^^^^^^^ 
showed that laboratory technicians were c hardly 

counts that agreed with 

have been accurately made. We sh consider the control 

intentional erring in laboratory ““■!= that in 
of intentional errors. For the eningV studLts in a laboratory 

two experiments examined f®™"' J clearinsmnce of data fabrication 
course in animal learning, one sh showing some devia- 

(Rosenthal & Lawson * 964 ). and ^^idence of outright 

lions from the prescnbed proce ^d experiments, 

intentional erring (Rosenthal & . reduced by the students’ 

the incidence of intenUonal urirng >n y edificaUon 

belief that their data were collected "Ot s.^ly tor 
but also for use by others for senous collected only for 

duction may be postulated if crl^ected for scieLfic 

laboratory learning are less sacreo 

purposes. employed as data collectors for scien- 

Student experimenter . r J 5 ,hat follow- 

tific purposes. In one ^u^^y of conversation could be 

ing certain reinforcement proce ^^,„pnters Azrin. Holz, Ulrich, and 
altered. Again employing ',*f;„ults However, an informal post- 

“nt^l ll!ekUerfh:;r S been fabricated by their student 
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IS of sufficient importance to have occasioned a panel discussion of the 
problem in the International Journal of Attitude and Opinion Research 
(1947) Such workers as Blankenship, Connelly, Reed, Flatten, and 
Trescott seem to agree that, though statistically infrequent, the cheating 
interviewer can affect the results of survey research, especially if the 
dishonest interviewer is responsible for a large segment of the data collected 
A systematic attempt to assess the frequency and degree of interviewer 
cheatmg has been reported by Hyman, Cobb, Feldman, Hart, and Stember 
(1954) Cheating was defined as data fabncation, as when the interviewer 


recorded a response to a question that was never asked of the respondent 
Fifteen interviewers were employed to conduct a survey, and unknown to 
them, each interviewed one or more “planted” respondents One of the 
“planted” interviewees was described as a “punctihous liberal” who qualified 
his responses so that no clear coding of responses could be undertaken 
Another of the planted respondents played the role of a “hostile bigot ” 
Uncooperative, suspicious, and unpleasant, the bigot tned to avoid com- 
answer at all on many of the questions Interviews 
tespondents were tape recorded without the interviewers’ 
ma^orr interview with the hostile bigot that most cheat- 

thi interview dall'th fabncated a great deal of 

mwe oTri “ interviewers tended also to cheat 

W^less m general, there 

refation to ‘,7 ‘hen, bore some 

extern predictable from onrsi.umZ TanXr"' 

emng"isTd? an7rm™fo,rd b7te rt dt 

can contnbute to the common riat \ occasion In science, a worker 
only once We should not, of cours^ e^ate 
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research is often a part-Ume einni«xr»<, i interviewer m survey 

and less interested m the scientifir ^ i educated, less intelligent, 

are the scientist, his students and ot the data collected than 

viewer has rarely made any idenuficaIion77 research inter- 

its very strong taboos against data fabricat' career role with 
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tammated’data Indeed, m the study of mte77T accurate, ‘uncon- 
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intentional error or an instance of incompetence so magnificent that one 
is reduced to laughter. Consider, for example, (1) an investigator mterested 
in showing the widespread prevalence of psychosis who chooses his sample 
entirely from the back wards of a mental hospital; (2) an investigator 
interested in showing the widespread prevalence of blindness who chooses 
his sample entirely from a list of students enrolled in a school for the re- 
habilitation of the blind; (3) an investigator interested in showing that the 
aged are very well off financially who chooses his sample entirely from a 
list of white, noninstitutionalized persons who are not on rehef. T 
first two examples are fictional, the third, according to the paps of 
Science, unfortunately, is not. (One sociologist 
too real “data”-collecting enterprise was told to avoid 
A spokesman for a political group which made use of ^ 
helpfully that the survey was supported by an orgpization having a »n 

ser^ative outlook” (Science, 1960). The f 

an oraanization having a “liberal outlook” would have made similp errors 
dthe^S incompetenc^e or of intent but rather that such errors do occur 
and may have social as well as scientific implications. 


THE CONTROL OF INTENTIONAL ERROR 
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experimenters When very advanced graduate student experimenters were 
employed, they discovered that the programmed procedure for controlling 
the content of conversation simply did not work 

Although It seems reasonable to assume that more-advanced graduate 
students are generally less likely to err intentionally, few data are at hand 
for documenting that assumption We do know, of course, that sometimes 
even very advanced students commit intentional errors Dr Ralph Kolstoe 
has related an instance in which a graduate student working for a well- 
toown psychologist fabricated his data over a period of some time Finally, 
the psychologist, who had become suspicious, was forced to use an entrap- 
ment procedure which was successful and led to the student’s immediate 
expulsion 
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pose that scientists may be affected by the widespread data tabncation they 
encountered in laboratory courses when they were still undergraduates. 
The attitude of acceptance of intentional error under these circumstances 
might have a carry-over effect into at least some scientists’ adult lives. Per- 
haps it would be useful to discuss with 

various sciences the different types of experimenter effects. They should 
but often do not, know about observer effects interpreter 
intentional effects, though they quickly learn of these ““ ^ ” 

instructors imposed more negative sanctions on da a f 

of education, perhaps there would be less intentional ernng at more ad 

most instructors of laboratory courses ‘n -™u^ 

well understood and are not highly jMormine what the “tight” out- 

ahead” in their texts it would ,j,g exercises should be on the 

come should be. „/ what the student needs to learn is, 

procedures rather than on the " ^et up a demonstration of 

not that learning curves descend, but how to set 

learning phenomena, how to o serv j , —^t them sensibly and in 
accurately, report them thoroughly, and interpret mem 

some cases even creatively. experiments performed before 

A general strategy might be t P 

the topics they are ( 1965 ), wouW be “What happens 

consistent with that please demonstrate what has been 

if we do thus-and-so rather than p 

shown to be true.” The procedures wouW have m 

plicitly for students, and generally t ? "‘good” data, students 

told what to expect and not being g" J phenomena before them 

might be more carefully perceptual field to those few 

without the single set which would restn inconceivable that under 

events that iUustrate a particular p • observe phenomena 

such less restrictive conditions ^oj gnnrse, if they 

that have not been observed “cW • ,^jgl5 observational 

record only that the rat turne "g instructor rewards with praise 

skills may sharpen, and c^pccin jf organism’s response. The results 

the careful observation g^Lt arc not new or exciting to the m- 

of a laboratory demonstratio p 
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open-books system, the borrower must make it convement for the lender 
A request to “send me all your data on verbal conditioning” made of a 
scientist who has for ten years been collecting data on that subject nghtly 
winds up being ignored If data are reasonably requested, the reason for 
the request given as an accompanying courtesy, they can be duplicated at 
the borrower’s expense and then given to the borrower Such a data-shanng 
system not only would serve to allay any doubts about the extent and type 
of errors in a set of data but would, of course, often reveal to the bor- 
rower something very useful to him though it was not useful to the original 
data collector 


The basic control for intentional errors in science, as for other types 
of error, is the tradition of replication of research findings In the sciences 
generally this has sometimes led to the discovery of intentional errors 
Perhaps, though, in the behavioral sciences this must be less true The 
reason is that whereas all are agreed on the desirability or even necessity 
0 rep cation, ehavioral scientists have learned that unsuccessful repbca- 
'a f* hardly know what it means when one’s data don’t 
and different ” ’ sampUng differences, different subjects, 

mwaf oX , Fo^dural differencis so 

from the failure lo a u tephcation but can conclude too httle 

usedtosuSlrth° been 

(1961) suggested that VeJ^TanckMms)’ TZ 1:*’’“ 

him In fact it cannot ui ^^^55) data collectors had deceived 
group had been deceived by 

self-correctine, but m the heho, collectors Science, it is said, is 

very slowly sciences especially, it corrects only 

In order to prevent thele errors ‘"‘^“honal error is its prevention 

about their causes There seems to have to know something 

as to what these causes miaht he ™ that point but few clues 

causes have been so idiosyncratic history of science the 

guesses about them, as when a scientist making any general 

embarrass another, or when an acc » instant eminence or to 

please him Crespi ( 1945 _ 46 \ £j|, . “ deceived the invesUgator to 
among survey research interviewers morale was a cause of cheating 

And what of the possibility that better oause of poor morale^ 

worsened performance, a possibility imiil!Iu"h ° ■mght be associated with 
Rtng ( 1961 )7 Of course, L need m ^ of Kelley and 

atically, but here the clanon call for “mf P^b'om more system- 

heeded Research on events so “hely to g^o nn- 

There is no evidence on the matter. butTseenis 

seems reasonable to sup- 
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review would be greatly improved if the authors’ name and affiliation were 
routinely omitted before evaluation.^ Author data, like experimental re- 
sults, detract from the independent assessment of procedures. 

1 Both Gardner Lindzey and Kenneth MacCorquodale have advocated this 
procedure. The usual objection is that to know a man’s name and affiliation provides 
very useful information about the quality of his work. Such information certainly 
seems relevant to the process of predicting what a man will do, and that is the task 
of the referee of a research proposal submitted to a research funding agency. When 
the work is not being proposed but rather reported as an accomplished fact, it seems 
difficult to justify the assessment of its merit by the reputation of its author. 



36 


The Nature of Experimenter Effects 


stmctor, but there is no reason why they cannot be for the student The day 
may even come when classic demonstration expenments are not used at 
all in laboratory courses, and then it need not be dull even for the instructor 
That the day may really come soon is su^ested by the fact that so many 
excellent teachers are already requinng that at least one of the scheduled 
expenments be completely onginal with the student That, of course, is 
more hke Science, less like Science-Fair 


If we are seriously interested in shifting students’ orientations from 
outcome-consciousness to procedure-consciousness there are some im- 
plications for us, their teachers, as weU One of these has to do with a 
change in pohcy regarding the evaluation of research To evaluate research 
too much m terms of its results is to illustrate outcome-consciousness, 
often Doctoral committees too often send the candidate 
o t e a oratory to run another group of subjects because the ex- 
(=>"d approved by them) yielded negative 
from oi ii°^^ universities show wisdom that protect the doctoral candidate 

PtolsaUsaTrr°"*“°“““ candidate’s thesis 

proposal as a kind of contract, binding on both student and faculty 

always account "* ““c publication policies One can 

to the sZfic oroeL negative result by refemng 

o ouV'^tcoL'^consr’ IS testament 

judged appropriate sensihi Pc°ccdures employed It the procedures are 
sions from the rll s ,? ’ 1" ^™.t conclu- 

on the basis of the results anrrqeLdTv“h "’T inconclusive 

the procedures were adequate wLd be mi h "f' ” 
come To accomplish this ^ mdepeudenUy of the out- 

mitially for editonal review or th!it'’'"r *1!''* only be submitted 

mferee or, at least, taan e^aliCi be sent to a 

the referee or editor reads the result-: Th^ procedures be set down before 

to decrease the outcome-consciousness of 

lead to an increased demand for lonmai ^ decisions, but it might 
could be met m part by an increased use of • W? „P’'“‘='“=ul problem 

the research in the journal but ornmi ,1- mports ’ which summarize 
interested workers Journals such as^L, , '"'“'ability of full reports to 
and Science are already making extens.v Psychology 

policies became less outeome-cotcl! reports If journal 

negative results, psychological researcherc* m the matter of 

by these policies that negative results unwittingly be taught 

suppressed In Part .1. u^atL “etlts^rb^H ^ 

as ong as the discussion has focused on editorial discussed further Here, 
cial to the development of our scientific life si i P° ‘“^s which are so ctu- 
should be mentioned that the practe o ■' 

reading manuscripts for critical 
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menters that have been shown to affect unintentionally the responses of 

their human subjects. . , 

The study of individual differences among people proceeds m several 
ways. Originally it was enough to show that such ^haractemtics as he.ght 
weight and inteUigence were distributed throughout a populat on and that 
of the distribution could be specified. Later 
shape of individual differences were well known, various 
weTe eolrelated with one another. That led to answers to 4—^ 
sort: are men or women taller, heavier, brighter, longe-hved Frmn ttoe 

studies it was learned which of the ""f “ roeTal S ed7- 

associated with many Others. It was foun a ^ ^ a great 

deal of difference if we correlated with 

though, it was a characteristic of p st„(iy of individual 

another characteristic of that pers ^ has^ become more complex 

differences among experimenters, . in relating characteristics 

and even more interesting. " "^racle^ but rather to his 
of the “P^rimenter, not to o he f h^ differences is not nec- 

subjects’ responses. The usual study 

essarily social Psy<=holog'<=^'- i^^ot of itself social psychologi- 
person A’s performance on a mo person B’s perform- 

cal. But the relationship ^ psychological. That person A 

ance on a motor task ,j,nn a parel sibUng, friend, or 

happens to be an expenmenter ^^ance but no special substantive 
child has special methodological importance but P 

importance. , . because so much of what has 

It has special methodological irnp learned within the context 

been learned by behavioral scien is personal characteristics of 

of the experimenter-subject interac • opbiects’ responses, then we 

the data collector have determine '"P jj jbere is no special sub- 

must hold our knowledge the ' ‘8 J . ja an experimenter rather 

stantive importance in the fact t a p ^ human organism behaving 

than some other P"f°“ L experimenter is no more a special case 

and affecting others behavior, P can generalize from 

than is a parent, sibling, fnen , ^ question as whether we can 

the experimenter to other peop parent, 

generalize from parent to frien • which show that different experi- 

There are experiments by significantly dillermt 

menters obtain from their c p „es to follow, however, major 

responses (Rosenthal, 1962). n rf,, dies showing that a particular type 

consideration is given only to associated vrith a particular 

of response by an “P"'f ^ .menter attributes that have been 
characteristic of the experimenter. Expe sometimes de- 

shown to be partial determinants of subjects P 
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search have*reV*'H°^ chapters some effects of experimenters on their re- 
perimentcr directly ', 0 ^^ 010 ?'^ operated without the ex- 

will turS to those 

under study perate by influencing the events or behaviors 

illustration's of those''expSenL*''^ff”* with 

studied It seems less hkely that these^tr ‘""“'"""S materials 
amples of experimenter efl^s that do .„n provide us with ex- 
speed of light or the reaction of „ »'c materials studied The 

ment of chromosomes withm a celUs nonTl °s ‘ho artange- 

dtffcrences among the invcstisators ^ effected by individual 

physics, chemistry, and moleLlar bmlT**"* ™ 

with larger biological systems we b ‘hose disciplines concerned 

the investigator can affect his’subiecf examples of how 

behavioral sciences there can be no h u ' ‘““h ‘he level of the 

tentionally affect the very behavior in n “Ponmenters may unin- 

Chnstie ( 1951 ) tells urh™ n. 

oratoiy could judge which of severareTo""^ “h^osvers in an animal lab- 
rat by the animal’s behavior m a mam P®‘*‘‘‘0‘“ors had been handling a 
(1964) noted how a dog’s heart rate coulL*'” h “P 

140) simply because a certain exDernnn^ ^ dramatically (from 160 to 
10 an animal’s performance of its ^ 3110 ^!^ The importance 

ecn pointed out for horses (Pfunrst ion? ‘ho experimenter has also 
po^oiscs (Kellogg, 1961) If ammai sublVn “*l 
interaction with a particular expenmente/ w by their 

subjects would also be, perhaps even more so “ “P^“ ‘hoi human 
on in the following chapters will be on thr, Pmnary focus m this 
38 oharactcristtcs of expen- 
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TABLE 4-1 


Mean Anxiety Scores as a Function of Experimenter 
Sex and Presence 


I Experimenter present 

II Experimenter absent 
but observing 

III Experimenter absent, 
not observing 

Sum 


SEX OF 

experimenter 

Male 

Female 

14 

20 

18 

22 

23 

23 

55 

65 


Difference 

Sum 

+6 

34 

+4 

40 

0 

46 

10 

120 


shown tor subjects contacted by 

the three conditions Female experi ^hen the expen- 

scores but not equally so in eac con sex-oE-experimenter effect has 

menter is neither present nor o „_ 3 fentlY insufficient to establish 

vanished The brief greeting peno expenmenter appears to 

the sex effect, but the physica pres ,j jjjjjgfgnces to be significant, 

augment the effect For convenience assum g^ ^ f 

we conclude that female expenmen ^ ^ ( 1 , 5 , r experimenters We 

their subjects only it the subjects o® sex-of-experimenter effect in the 

cannot say, however, whether the gr unintended behavior on 

“experimenter present” condition w physical presence was simply 

the part of the experimenters “f beine observed by an experimenter 

a more constant reminder that *0^ shown ^no difference between Condi- 

ot a particular sex It the results hadjho more likely a 

tions I and II, we could have ooncluded that^^^^ b 5 „ 5 t 

passive rather than an active e ^ , mven sex, without any °PP°^ 

of being observed by an °;. 3 Jv,s h.s subject, was sufficent 

tunity for that experimenter to brtave 
to account for the obtained sex c 
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fined independently of the experiment m which their effect is to be assessed 
That IS the case for such biosocial charactenstics as sex, race, age, religion, 
and for such psychometrically determined variables as anxiety, hostility, 
authontanamsm, and need for soaal approval Sometimes the relevant ex- 
perimenter attnbutes can be defined only in terms of the specific experi- 
mental situation and the specific expenmenter-subject interaction Such 
attributes include the status of the experimenter relative to the status of 
the subject, the warmth of the expenmenter-subject relationship, and such 
expenment specific events as whether the experimenter feels himself ap- 
proved by the principal investigator or whether the subject has surpnsed 
him with his responses 


Quite a little is known about the relationship between these different 
experimenter variables and subjects’ behavior, but little is known of the 
mec amsms accounting for the relationships For example, we shall see that 
SLk ^^Penmenters often obtain different responses from their 

faint or fh , f tind femnles look dtf- 

or boft of slightly diflorently, 

respotefti “L. '' I ™tvey tnterv.ewer obtn.n different 

becwse he aL because of his dark skin or 

both these factors'? ^ different tone of voice or because of 

perimenter effects Actre"£sTre“faf'''"®“''’ 
ferences in the exnerini,»nt ’ u u associated with unintended dif- 

subject-s responL^s to the 

differences in the behavior of thVe^' associated with no such 

ascnbcd to their appearance alone and therefore must be 

extremely difficult ''o'nflnr'no and passive effects is an 

would be helpful in m’akmv such ’’a™ reported that 

distinction between active and on'* ^ “ay help illustrate the 

expenment designed to asseL uie m l? " hypothet.cal 

pose that femak expenrntos ? “ ' ‘>'eBe efccts Sup- 

anxiety obtain consistently higher ^ questionnaire to assess 

do male experimenters To simohfv in"i/ from their subjects than 
honnaire is virtually self-administerme n rf?'' ‘hat the ques- 

present in the same room with the subiect" n* experimenter ts simply 
experimenters and 10 females, each of “Pot™ent requires 10 male 

individually to 15 male subjects For om- attnumsters the anxiety scale 

menters excuse themselves and say that the?? ®“hjects, the expen 

he busy witroffi??? ‘‘“""S 

to the other side of an obvious one waJm.r" ? "’h“h take them 

lime to time ‘see how you arc doing” Another t^ao from 

are old the same thing except that the cxnenm “ta subjects 

to leave the building The light is left on ir^ ror ’’“s 

me room on the other side of 
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Often in our discussion of the effects of vanous expenmenter attnbutes 
on subjects’ responses we shall wish that data of the sort just now invented 
were really available Sex, age, and race are vanables so immediately 
assessable that there is a temptation to assume them to be passive in their 
effects That assumption should be held hghtly until it can be shown that the 
sex, age, and race of an experimenter are not correlated with specific be- 
haviors m the expenment Conversely, expenmenter’s “warmth” sounds so 
behavioral that we are tempted to assume that it is active m its effects Yet 
a “warm” expenmenter may actuaUy have a different fixed appearance 
from a cooler experimenter 


The order of discussion of expenmenter attnbutes proceeds m this 
and the foUowing chapters from (1) those that appear most directly 
obvious (i e , sex) to (2) those that are thought to be relatively fixed 
psychologicd charactenstics (,e, need for approval) to (3) those that 
thoTeT? “W=rpersonal nature of the expenment to (4) 

Siould he r ''7 ! This organntation ts arbitraiy and it 


Experimenter’s Sex 

and female expenmeWersTome^^ shows that male 

their subjects It is not alwavs S'gn>ficanlly different data from 

penment just how sub et!’ T “y S'"*" ‘yP= 

L. tf .nieedtr:^':: 

results of three cxpenments ii ” verbal learmng the 

holm (1957) found that their attmcuTfcm f »)“- 
mficautly better learmng from hertuhr^ “btamed sig- 

experimenter, descnbed as an “ex mn » ^ husky male 

Harmatz (1965) found that their m.i Sarason and 

belter learning than did their femaU obtained significantly 

(I960) round out this illustrauonbv and Buss 

a male and female experimenter Thi« of no difference between 

as to how we may reconcile these inmnc provides a clue 

findings Ferguson and Buss had their statistically quite real 

lo some of their subjects and neutrallv behave aggressively 

behaved more aggressively there was d^ret^ed l' “P=nmenter 

that Binder and associates’ ex- manne office?Mvrin'n® “ 
to his subjects, their results seem consistent .v ° ^SStussive impression 
Buss^ However, we would have to assume furth!' 0 ,°^° Ferguson and 
maus female experimenter was perceived as mnr' Sarason and Har- 
jeets, and for this we have no good evidence hy her sub- 

Serason (,962), i„ any ease, ten® s .0 weaken of ‘’y 

I least to complicate 
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Often in our discussion of the effects of vanous experimenter attributes 
on subjects’ responses we shall wish that data of the sort just now invented 
were really available Sex, age, and race are vanables so immediately 
assessable that there is a temptation to assume them to be passive in their 
effects That assumption should be held hghtly until it can be shown that the 
sex, age, and race of an experimenter are not correlated with specific be- 
haviors in the expenment Conversely, expenmenter’s “warmth” sounds so 
behavioral that we are tempted to assume that it is active m its effects Yet 


a warm expenmenter may actually have a different fixed appearance 
from a cooler expenmenter 


The order of discussion of expenmenter attnbutes proceeds in this 
and the following chapters from (1) those that appear most direcUy 
0 (i e , sex) to (2) those that are thought to be relatively fixed 
psychologic^ characteristics (le, need for approval) to (3) those that 
tw ™ interpersonal nature of the expenment to (4) 

IhonW he nituational This organizauon is arbitrary and It 

latedwitheachmte ‘ attnbutes discussed may be corre- 


Experimentet’sScx 

and female expenrnenterrsome^r ™*''eh shows that male 

their subjects It is not alw tnes obtain significantly different data from 
penment' u how sub 00 ^^ 'yP= 

L, If inLd';h:r:“is':: 

results of three exoenments n™ 11 verbal learmng the 

holm (1957) found^that their attracti^T “"i Sj°- 

mficantly better learmng from her 51 *^ 1 ^ “Penmenter obtained sig- 
experimenter, descnbed as in “a ® husky male 

Harmatz (1965) founi SaraTon and 

better learning than did their femai P®n*ii®nter obtained sigmficantly 
(I960) round out this dlustrTuirbv , 1 .''’’'™“'" 
a male and female experimenter This: i difference between 

as to how we may reconcile these tnr.«^ experiment also provides a clue 
findings Ferguson and Buss had their statistically quite real 

t^o some of their subjects and neutrallv behave aggressively 

behuved more aggressively there was “P™menter 

that Binder and associates’ ex-mannl offirer rav'r™"® assume 

to his subjeets, their results seem consistent “ “‘SS^^ssive impression 
Buss However, we would have to assume furthe Ferguson and 

matzs female experimenter was perceived as mn' Satason and Har- 
jects, and for this we have no eood evirf ® 8 g*‘essive by her sub- 

S-„„ (,962). in any case. mnCoral": ofr!l" 

‘*1 least to complicate 
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Often m our discussion of the effects of various experimenter attnbutes 
on subjects’ responses we shall wish that data of the sort just now invented 
were really available Sex, age, and race are vanables so immediately 
assessable that there is a temptation to assume them to be passive m their 
effects That assumption should be held lightly until it can be shown that the 
sex, age, and race of an experimenter are not correlated with specific be- 
haviors in the experiment Conversely, experimenter’s “warmth” sounds so 
behavioral that we are tempted to assume that it is active m its effects Yet 
a “warm" experimenter may actuaUy have a different fixed appearance 
from a cooler expenmenter 


The order of discussion of expenmenter attnbutes proceeds in this 
and the foUowing chapters from (1) those that appear most directly 
0 vious (i e , sex) to (2) those that are thought to be relatively fixed 
psychological characteristics (i e , need for approval) to (3) those that 
inn? on the interpersonal nature of the expenment to (4) 

SoL h ''7 ! This organization is arbitrary and it 


Experimenter’s Sex 

and fem^e expenmenterrs?m(!i'*’ shows that male 

their subjects ^It is not alwavs Afferent data from 

penment just how siibiects’ L ^ ° ? predict for any given type of ex- 

L. If inieed rre t:: expelenter’s 

holm (1957, “<1 Sjo- 

nificantly better learning from hr expenmenter obtained sig- 

expemnenter, descnbTfs an “ex " Iff ‘‘ •'usky male 

Hannatz (1965) found that their mat?"' Sarason and 

better learning than did their femni ^*P^”’”anter obtained significantly 

(I960) round out this ilIustraUonbv'the?’™“^"*“ T^eguson and Buss 

a male and female experimenter Thic i o( oo difference between 

as to how we may reconcile ihesp oxpenment also provides a clue 
findings Ferguson and Buss had statistically quite real 

to some of their subjects and neutrallv behave aggressively 

behaved more aggressively there was dL- '''hen the expenmenter 

that Binder and associates’ cx-manne (earning If we can assume 

to his subjects, their results seem consisipni^^ff’, “Sgtessive impression 
Buss However, we would have to assume f ?v,'^ Ferguson and 

mau's female experimenter was perceived a? ” Har- 

jeets, and for this we have no good cviden?e“ 

S-o„ (1963), m any ease, Jds to wX^ o^art^P"^ 
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Often in out discussion ot the efiects of vnnous experimenter ““"bu to 
on subjeets’ responses we shnU wish that data ot the sort just 
were reaUy avS^able Sex, age, and race are vanables so mniediately 
assessable tot there is a temptaUon to assume them to be passive m toir 
effects That assumption should be held hghtly until it can be shown that the 
sex, age, and race of an experimenter are not correlated with specific be 
haviors m the expenment Conversely, expenmenter’s ‘ warmth 
behavioral that we are tempted to assume that it is active in its efiects Yet 
a “warm" experimenter may actuaUy have a different fixed appearance 
from a cooler experimenter 

The order of discussion of expenmenter attributes proceeds in this 
and the following chapters from (1) those that appear most directly 
obvious (1 e , sex) to (2) those that are thought to be relatively fixed 
psychological charactenstics (le, need for approval) to (3) those that 
seem quite dependent on the interpersonal nature of the expenment to (4) 
those that are very highly situational This organization is arbitrary and it 
should be remembered that many of the attnbutes discussed may be cone- 
latedwith each other 


Experimenter’s Ses 

A good deal of research has been conducted which shows that male 
and female expenmenters sometimes obtain significantly different data from 
their subjects It is not always possible to predict for any given type of ex- 
penment just how subjects’ responses will be affected by the expenmenter’s 
sex, if indeed there is any effect at all In the area of verbal learning the 
results of three expenments are illustrative Binder, McConnell, and Sjo- 
holm (1957) found that their attractive female expenmenter obtained sig- 
mficantly better learning from her subjects than did a husky male 
experimenter, desenbed as an “cx-manne ” Some years later Sarason and 
Harmatz (1965) found that their male expenmenter obtained significantly 
better learamg than did their female experimenter Ferguson and Buss 
(1960) round out this illustration by their report of no difference between 
a male and female experimenter This last expenment also provides a clue 
as to how we may reconcile these inconsistent but statistically quite real 
findings Ferguson and Buss had their expenmenters behave aggressively 
to some of their subjects and neutrally to others When the expenmenter 
behaved more aggressively there was decreased learning If we can assume 
that Binder and associates’ ex-manne officer gave an aggressive impression 
to his subjects, their results seem consistent with those of Ferguson and 
Buss However, we would have to assume further that Sarason and Har- 
matz’s female experimenter was perceived as more aggressive by her sub- 
jects, and for this we have no good evidence Another experiment by 
Sarason (1962), in any case, tends to weaken or at least to complicate 
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.h. 1. “ f Kr™SSi''s;;,rrx. 

10 female expenmenters m a verba g jjostile verbs 

to construct sentences and were ronfor flashing a blue Ught. Mote 

by the experimenter’s saying ^ obtain more hostile responses 

hostile expenmenters of ^ experimenters earning higher hos- 

(p < .10). If we can assume that those e p t,:ects, then we have 

tility scores behaved more aggrcssivdy toward ‘^JJby’ Ferguson and 
a sLtion hard to reconcile ^as that the re- 

Buss. A further complication m acqmsition of hostile 

lationship between expenmenter hostih y ^nJenters were males 

responses was particularly marked when the exper 

rather than females. ,,8 is a very special case 

Perhaps, though, the ^ correlated with the hosbhty 

of verbal learning, especially when & expenmenters 

of the experimenters. One wonders first-person pronouns, 

would also be more eSective reinforci g ^swer, which, though a htfle 
Sarason and Minard (1963) HostiUty of experimenters neither 

equivocal, must be interpreted as a ^limenter affected the rate of select- 
alone nor in interaction with sex of ^ reinforced by the eight male and 
ing the first-person pronouns which interest to 6®“^ 

eight female experimenters of 7 f ^ ind^situafional variables was *e find- 
discussion of experimenter a«nb“7 ‘' pronouns was a and 

ing that the verbal learning 0 first-person p boshlity, and 

of%xperimenter sex, hostility. ^ P^ISmenter and subject. It appei^ 
degree of personal contact Cloning, when an " 

that at least in studies of verbal cond. io^ng interactions, these m er- 
designed as to permit the rarely, however, are most of 

actlL are forthcoming in abundance, only 
them predictable or even '''‘^^P^'^^inance as well as in verbal 

In tasks requiring motor “ the sex of the expenmenter 

young children I well as for ;„d Odom 

may make a significant administer a l^vej-P^^S ‘“7° 

two male and two female expen uyen. From time to time ^ 

children ages six to seven and ten various pictu 

were rewarded for pulling the '77y„'’7ctments were provided m order 
filmstrip. During the first minute ^“"fling could be dete^med. Eien 

that a base line for each subje „T_of-expcrimentcr effe _ 

during this first minute, sig"'*''®" experimenters made ^ P 

(D <■ 001). Subiects contacted by male expenmenters. 

cent more responses than did for the fact that ‘‘'“^rfinenters 

This targe effect was the more^^x msk pv/fo"’ f 
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expenmenters obtain greater performance than female expenmenters m a 
simple motor task, in this case, dropping marbles in a hole As in the other 
experiment, the first minute served as a base rate measure after which the 
experimenter began regularly to deliver compliments on the subjects per- 
formance This time the subjects were younger still, ages three to five Sub- 
jects contacted by male expenmenters dropped about 18 percent more 
marbles into the holes than did subjects contacted by female experimenters 
dunng the initial one-minute period (p < 05) As expected, female experi- 
menters’ subjects increased their rate of marble dropping after the reinforce- 
ment procedure began Relative to the increasing performance of subjects 
contacted by female experimenters, those contacted by males showed a 
significant decrement of performance during the following period of rein- 
forced performance (p < 01) The interpretation the investigators gave to 
the significant sex-of experimenter effect was particularly appropriate to 
their very young subjects Such young children have relatively much less 
contact with males, and this may have made them anxious or excited over 
the interaction with the male expenmenter For simple tasks this might have 
served to increase performance which then fell off as the excitement wore 


off from adaptation or from the soothing effect of the experimenter’s com- 
pliments The anxiety reducing aspect of these statements might have more 
than offset their intended reinforcing properties 

We have already encountered the fact of interaction in the study 
of sex of experimenter m the work of Sarason (1962) One of the most 
requently investigated variables, and one that often interacts with expen- 
menters sex IS the sex of the subject Again we take our illustration from 
evenson ( ) The task, as before, is that of dropping marbles, and 

^ter the first minute the experimenters begin to reinforce the children’s 
j^Sularly complimenting them The six male and six female 
to^iir ^ ministered the task to children in three age groups three 
the exnpnm ^ t Although the individual differences among 

sex ST'"’ greater than the effect of expenmenter 

htgher perfomtanTfTVe"' sutecM' -TloT'J 

expenmenters obtained a 

experimenters but nniv ncrease in performance than did male 

children (9-l’o) there'^wa's a^" trade®"' '^•“Idren Among the oldest 

effect Amona these childrpn (P < 10) for a reversal of this 

crease m performance These TmnsT'"°'h'"* obtained the greater in 
interact with the age of subiectfft was bow sex of experimenter can 

(age 6-7) that the sex ofTllTTr children 

clearly Male expenmenters obSe^rTL" 

from their female subiects and i increase of performance 

ejects, and female experimenters obtained the greater 
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tendency wns found among the old ( psychoanalytic 

tive interpretations of ^TtStt of deprL- 

thcory of development as well as in , sex. 

tion of contact with members of the exp ^ subject’s sex are not 

The interacting cfTects e childre'n. Stevenson and 

restricted to those studies m ‘‘V J.„,rimenters conduct a marble 

Allen (1964) had 8 male “"f ® J„egc students. For the first 90 

sotting task with 128 male an ^-ment for sorting the marbles by color. 

seconds subjects received no U ^nls to the subject on his or her 

Thereafter the experimenter paid comp individual differences 

performance. Once again, ^ pf performance shown by 

among the experimenters of bot sex . interaction between the 

their subjects. In addition, howeve , g typen male expen- 

sex of subjects and sex of female experimenters con- 

menters contacted female subje marbles were processed than when 

tacted male subjects significantly mo difference was 

the experimenter and subject ^ experiment and for the entire 

significant during the first 30 secon generality of the interac- 

experiment as well. Even further s“PPOrtJ°; Stevenson and 

tion of experimenter and ^ predicted interaction when the 

Knights (1962), who obtains^ * P 60. 

subjects were mentally retarded, averaging ^ Stevenson and 

In trying to understand the increased compeUtive- 

Allen posmlmed that the effects ^be due^^ experimenter was 

ness, higher anxiety, or a gre grantee however, as Stevenson ( 

of the opposite sex. There is no guamnt ^h ^ ^ 

points ouV that experimenters may >«« iu this section some 

differently than subjects °f f c sa hypothesis. . . 

data will be presented which bear o JP ,s significimt 

K the interaction between ettpenmenm^^^^pPoP of simple sentences 
in such tasks as marble sorting an ^j^p ^objects’ ‘a*® 

we would expect the phc"°menon and Parsons (1^2) 

responses are more dramatic on • -ypOon which is instrucUve. 
conducted an experiment in sensory d p ^j^me hours and the 

and female subjects were floated in a tan Coring their isolation 

responded to five questions abom the^^^^^P^ ^ ^^jp p^penmenter, Mf 

period. Halt the time subjects w feelings . 

the time by a female. The ques ^ual feelings, (4) anything 

the most unpleasant expenence, O) jcx ^ hie total experience was 

about oneself from the experience andJS>^^ ^ „hich measu ed the 

reminiscent of. All ^ent or unusualness of the p c"°m 

degree of psychological invo experience, his score was 

perienced. If a subject reported no exp 
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ported hallucinations with real feeling the response was scored 5, the 
maximum Intermediate between these extremes was a range of scores 
from 1 to 4 For two of the questions the interaction between sex of expen- 
menter and sex of subject was significant To the question dealing with sex- 
ual feelmgs, subjects contacted by an experimenter of the same sex gave 
replies earning psychological “richness” scores three times higher than when 
contacted by an experimenter of the opposite sex This was the most signifi- 
cant finding statistically and in terms of absolute magmtude In a subsequent 
study, although m sm^er and less significant form, the same effect was ob- 
tained (Walters, Parsons, & Shurley, 1964) This particular interaction 
seems less difficult to interpret than that found for the marble sorting expen- 
ment Even m an expenmental laboratory, subjects regard the “mixed com- 
pany ’ dyad as not a place to discuss sexual matters freely 

In survey research, as in the expenmental laboratory, the inhibiting 
effects of “mixed company” dyads have been demonstrated Benney, Ries- 
man, and Star (1956) reported that when given an opportunity to assess 
the cause of abnormal behavior, respondents gave sexual interpretations 
about 25 percent more often when their interviewer was of their own, 
rather than the opposite, sex About the same percentage difference oc- 
curred when a fuller, frank discussion of possible sexual bases for emotional 
disturbance was invited Interestingly, moralistic responses were more fre- 
quent when the interviewer and respondent were of the opposite sex Ap- 
parently, then, m interviewer respondent dyads, sex matters are less Ukely 
to be brought up spontaneously in nuxed company, but if they are brought 
up by the interviewer, opposite-sexcd respondents are more likely to take a 
negative, harsh, or moralistic stance than same sexed respondents Addi- 

workers7l954) >>y Hyman and 

m<.nt!r P™)'f appraising personality, the sex of the experl- 

Snn notm responses-sometimes 

«uies®sho„,n ’ «his literature whieh consists of some 

Studies showing a sex effect, and some not 

exnenmemL' »£ 
menters eheit differem^rp^LTbeeamr^y tave a'i 

™ one of person perception s’nbjects Tre' asMto"™.''" J’’" 
success or failure reflected in the faces ^ 

The ratings of the photographs could range from P'’°‘°gf=‘P'’* 

+ 10 . extreme success The standardiX^a ofThe^ ol' T”" *“ 

contacted 3d female and 33 nia.e ^s^^ 
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tween experimenters and subjeets -e mmed « 

either. Details of the procedure, but not the da 1965). Table 

been described elsewhere (Rosent a, ’ j and female experi- 

4-2 shows the mean photo ratings obtained by the male lem f 

TABIF 4—2 


Mean Photo Ratings by Four of Subjects 


SEX OF 

experimenter 

Female 


SEX 

OF 

SUBJECT 


Male 

Female 


Mole 

+0.14 

+0.31 


+0.40 

-1.13 


, Dnlv the results from those 33 

menters from their male and j included. Female subjects, when 

subjects whose interaction was m photographs as bemg 

contacted by female experimenters, combinations of expen- 

of less successful persons than i , lifter from one another, 

menter and subject sex (p < -05), j ,l,at male expen- 

When the sex of subjects variable (o = 1-97) in the dam 

menters were significantly {p< • ^ female experimenters Co- 

they obtained from their subjects than we [ 1961 ], though 

0.61). (A sinular tendency ‘f’^^feuUy.) When the sex of the 
there the effect was not „hen experimented and ^objects 

subjects was considered, it de p , -gpjgi ratings (<r = 1-68) wa g 
were of the same sex the vanabi y „ dyads were compose 
nificantly (p = -06) . 

opposite-sexed persons (cr — y* '' „„pest that the effects of 

Some data are available "'h'* s^e. It appears that male and 
menter sex are active rather t ^ P jheir subjects in the 

female experimenters behave 7 observations were made of the 

ment. In Lnection with “''’'J'^l^^^octivity level, and *= "y 
experimenters’ glancing, smiling. P — . 1964; Katz, 196 ). 

of his reading of the instrucUon < for this analysis. D“"ng 

workers kindly made their raw instructions to the *“’’1^ 

brief period preceding the expenro identifying data as n^a, g , 

the experimenter asked the (ion period there was no di5amn“ 

class, and college major. In this p number of glances th y 

between male Ld female experunenters 
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changed with their subjects However, experimenters tended to exchange 
more glances with their female subjects When interacting with male sub- 
jects, 38 percent of the expenmenters exchanged at least some glances, but 
when interacting with females 90 percent exchanged glances The average 
number of glances exchanged with male subjects was 3 1 and with females 
75 ip < 10) This finding that females drew about 2 4 times as many 
glance exchanges as males is close numencally to the ratio of 2 9 reported 
by Exline (1963), m spite of the differences in the group composition, ex- 
perimental procedures, and measures of glancing behavior employed in his 
and the present study 

Dunng the reading of the formal instructions to subjects, an interaction 
appeared in the glances exchanged Now experimenters exchanged more 
than twice as many glances with subjects of their own sex (mean = 1 44) 
as with subjects of the opposite sex (mean = 0 62) (p < 10) 

In this experiment, the subject’s task was to rate the 10 photos in se- 
quence, and dunng this rating phase of the experiment the experimenter’s 
task was to present the photos m the correct order Richard Katz made 


observations of the experimenters' glancing behavior separately for those 
times when the experimenter was actually presenting a photograph and 
when the experimenter was preparing to present the next stimulus There 
was an interesung difference in the glancing behavior of experimenters 
as a function of the phases of the stimulus presentation During the 
photo presentations male subjects were glanced at more (mean = 1 9) 
than female subjects (mean = 1 5), the difference not reaching significance 
1 ^ Dunng the preparation penods, however, male subjects were 
glanced at less (mean =11) than female subjects (mean = 1 7) This 
interaction effect was significant (p < 05) and was shown by all but one of 
the eyenmenters Dunng the presentation period the subject is somewhat 
on the spot The experimenter is just sitting expectantly, and the subject 
thic ^ and wants to do it well It could easily be that dunng 

femrti”” moment experimenters avoid eye contact with their 

Itrcmllv ™barrassment This seems an 

reduceddunngimeeviewscreingg^irenjrr 

Asthe"e~rrs P-™- - “I 

not fearforZr ™ presentation, they need 

not tear for their female subjects’ tension and indeed their increased Planc- 
ing at this point toward their female subiects mav sprvt , ^ 

that all i<5 wpii I ♦ . 1 . L may serve to reassure them 

ment IS into corrrf^H '“"8 P^o^ °f ‘he experi 

ment IS in fact correlated with smiling at the subject (rho- 63 n - 101 

rn^and";; -- during tL stale of’tL“expei 

ment and, dunng either the presentaUon or the preparahon period ron- 

sidered separately, IS not significantly related to glancing 
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From these results it can be seen that experimenters do in fact behave 
diflerenUy toward their’ sub, eets 

times to the sex of the subject, som nattern of experimenter 

someumes to both these variables e p psychological expenment, 

behavior descnbed suggests that at ea P ^ attentively 

chivalry is not dead Female sub, eets seem to be treated mor 

and more considerately than male subjects behavior during the 

While discussing the differences in ^j^er example of 

stimulus presentation and P^^^y^gyc of the female experimenters 

expenmenter sex effect can be giv presentation penod 

showed more smiling during the prepara Among male 

with an average 35 percent and the average in- 

expenmenters, however, only one J sometimes during those 

crease was only about ’2 percent ‘’’.^^nTed ^rformah and 

moments of the experimental fpctioning as quite compe- 

austerity seems lessened, females, even jpapy do Those sociological 

tent experimenters, behave more as cin differentiation would prob- 

wnters who have been concerned wi interpretation Parsons 

ably not be surprised either at these data or anhe.r^^_ J 
(1955), Parsons, Bales, and Sh‘'a socioemotional concern 

commented on the femimne role -nncem with task accomplishment 

and the masculine role as ‘^at of gt«a ® support this conception Not 

The data presented so fat and those leader when she is the leader 

only IS the female more of a aocioenouonal leM 

but she seems much more to be e ao pjccedmg the formal instruc- 
lower For example, during the brief p ^ore often than were 

tions, the female subjects were smi e ^ 05) When 

male subjects, regardless of the sex experimenters smiled at leas 

contacting female subjects, 70 P^^"* “/^.fol'^bout 12 percent did so 
a httle, but when contacting male su , g ^,5 by all expenmenters was 
The mean amount of smiling at Dunne the subsequent reading o 

0 50. at male subjects it was only smihng and only 40 pcrccn 

the instructions, all experimenters sh no expenmenter smiled 

of the experimenters smiled at cma smiling in this phase ° 

even a hltle at any male subject Most of to o57) rather than 

experiment was done by j'Se was not very significan 

males (mean = 0 10), th°“8Vc«en.crs tended m 

(p= 15) To summanze, female ^,W more smiles 

female subjects were recipients of sig Jnian (1964) calls an cuqucltc 

Although no one Ins written W enaction of most laboratory psj- 

for the psychological o'P'"'"'" „umc that female expenmenters might 
chologists to these data lias been ° nis if the) smile more than ) 

be less competent at conducting c [k senous inieraciion a 

-should- Smiling seems frwolous m such 
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between expenmenter and subject But data are available which show that 
females, by an important cntenon, are at least as competent as males Ac- 
cording to sconng categories developed by Friedman (1964), a scale of ac- 
curacy of instruction reading was developed Errors m the reading of 
mstructions would lower the score from the maximum possible value of 
2 00 A more competent expenmenter, as a minimum, should read the in- 
structions to subjects as they were wntten Accuracy of instruction reading, 
then, is an index of expenmental competence, though not, of course, the 
only one Table 4-3 shows the male and female experimenters’ mean ac- 

TABLE 4-3 


Accuracy of Instruction Reading 


SEX OF 

EXPERIMENTER 




Male 

Female 

Difference 

P 

SEX 

Ma/e 

1 62 

2,00 

+ 38 

.20 

OF 

SUBJECT 

Female 

1 so 

1.87 

+.37 

.12 


cura^ scores when the subjects were males and when they were females 
or ot ma e and female subjects, female expenmenters read their instruc- 
hons more accurately than did male expenmenters (combined p < 05) 
^ong female experimenters, 80 percent read their instructions perfectly to 
rate percent of male experimenters were that accu- 

lects mstructions were read to sub- 
sub ectslereaf"T“‘"' 88 percent of their 

cent ot their subjecTs 'hem perfectly only to 56 per- 

with which threxn° ^**"^'* expenmentcr’s or subject’s sex on the speed 
ml!k itse Jwrerr' '"ose penods of the rat- 

photo T^bt 4^ sW T""""'” 'he next stimulus 

'of te mttacrnlTmale an'dlLr e™ PT 

and female subjects The only sigmficant effe^rf “"‘'‘=""8 "f 
Male expenmenters were signSnUy sCe‘7n ,b ‘"'emction vanety 

C4;Trs*rrr r 

they were males Similarly female expenmenters were slower when inter- 
acting with male rather than female subjects, although this Lrdencrwas 
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TABLE 4-4 


Time Required for Stimulus Preparation 


SEX OF EXPERIMENTER 




Male 

Female 

SEX 

Mofe 

33.2 

45.4 

OF 

SUBJECT 

Female 

38.4 

40.3 


Difference 

P 

+5.2 
< .01 

-5.1 
> .20 


Difference P 
+ 12.2 < -20 

+ 1.9 > -20 


. experimenter m ms 

not significant statistically. With late teens, it appeared almost 

twenties and the average female ” oio„g this portion of their m- 

as though the male experimenters so“S period^ of the experiment wa 

teraction with their female subjec s. . characteristics compare 
earlier interpreted as having which 

the periods of tension increase ? extra seconds of relaxe 

followed these preparation periods. because of their intrinsic socia 
tact may have been stretched somew ® members. Because 

terest when the dyads were of opposU^ experimenter we would not 

ITpSK -S;; « ■. S 

ob.™ion. «« ”i.s “rrrs 

experimenter leaned in the direcUon ^^^^^^primenter 

were seated diagonally across the e g tended to bring exp . 

the leaning was'in a -^eways direcu^n^^^^^, T “de"to reSuc” S: 
and subject closer together. T pxoerimenters tended , • _ *^5 

describing how much male and ? nd female subjects ® . 

distances between themselves -"d ‘heir m®'e ^ ^ pds by 

entire rating period. The results £“ '^e enur^^ P'^>"*‘"'®rc,rwere con- 
nificant, although the instruction ^l,cn female su je males, 

themselves did not show significan effect. When subjec . mers 

tacted there was no sex-of-exi«nme"terjn «P®"” 

however, male experimenters mers, females may hav closer 

(p < .05). Relative to male that would move them 

bashful or modest in assuming any p tended 

to their male subjects. instructions male experi 

During the reading ot 
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TABLE 4-5 


degree of Leaning Toward Subjects 


SEX OF EXPERIMENTER 




Male 

Female 

SEX 

Male 

1 35 

0 75 

OF 




SUBJECT 

Female 

0 99 

0.96 


(p < 10) to show a higher level of general body activity (mean = 6 2) 
than did female experimenters (mean = 4 4) This was true regardless of 
the sex of the subjects contacted Then, in the period dunng which subjects 
made their actual photo ratings, there was a tendency for all experimenters 
to show a greater degree of general body activity when their subjects were 
males (mean = 4 4) rather than females (3 9) This difference was not 
very sigmficant statistically, however (p = 15) In our culture, general 
body activity is associated more with males (Kagan & Moss, 1 962, p 100) , 
and male psychological experimenters, as any other members and prod- 
ucts of their culture, do show more body activity in the experiment 
That both male and female experimenters may show greater activity when 
contacting male subjects suggests that there may have been a kind of ac- 
tivity contagion and legitimation in the interactions with male subjects, who, 
we can only assume, were themselves more active during the experiment 


TABLE 4-6 

Experimenter's Body Activity 

SEX OF EXPERIMENTER 




Male 

Female 

Meons 

SEX 

OF 

Male 

46 

4 3 

4 45 

SUBJECT 

Female 

4 1 

38 

3 95 


Means 

4 35 

4 05 

4 20 
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Unfortunately, systematic observations have not yet been made of the sub- 
jects’ activity level. Table 4-6 is relevant to the interpretation. Although 
none of the effects reach statistical significance, it can be seen that during 
the rating task on which these means are based, male experimenters move 
more, and most of all when contacting male subjects. Female experimenters 
move less, and least of all when contacting female subjects. Sex differences 
in the degree of motility of the experimenters seem to be well augmented by 
the hypothesized contagion and le^timation effects of being in interaction 
with people who very likely vary in their own degree of body motility. 

Another line of evidence is available that male and female experi- 
menters behave differently as they conduct their psychological experiments. 
Suzanne Haley kindly made the raw data available for this analysis. She had 
12 male and 2 female experimenters administer the same photo-rating task 
to 86 female subjects. After the experiment, subjects were asked to rate 
their experimenters on how well they liked them and on 26 behavioral 
variables — e.g,, degree of friendliness of the experimenter. Table 4-7 shows 

TABLE 4-7 


Ratings of Experimenters and Sex of Experimenter 


SOURCE OF RATINGS 



Subjects 

Observers 

Ratings 

fpb 

P 

'■pb 

P 

Friendly 

+.32 

.005 

+.47 

.05 

Pleasant 

+.37 

.001 

+.28 

- 

Interested 

+.27 

.02 

+.36 

- 

Encouroging 

+.27 

.02 

+.35 


Enthusiastic 

+.27 

.02 

+.41 

.10 

Pleosant-voiced 

+.42 

.001 

-.11 

- 

Expressive-voiced 

+.26 

.02 

+.20 

- 

Leg activity 

+.30 

.01 

+.20 


Body activity 

+.23 

.05 

.f .31 


Medion 

+.27 

.02 

+ .31 

- 


the ratings of the experimenter’s behavior as a function of the sex of (he 
experimenter. The correlations arc point biscrials and when positiw in 
sign indicate that it was the male experimenters who were rated higher on 
the scales listed in the first column. The first column gives the correlations 
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resulting from this analysis It can be seen from the table that ‘ho 
subjects of this expenment rated their male expenmenters as 
in general, as having more pleasant and expressive voices, and as bemg mo 
acL physically The nine correlations tabulated for ttas analysis ttose 
sigmficant at the 05 level out of the total of 26 possible (As nugW he ex- 
pected from the obtained correlations, male expenmenters were also 
hked, r 1 = 34, p < 005 ) The magnitudes of the tabulated correlations 
tend to be conservative because only 10 of the 86 subjects were contacted y 
female expenmenters The median correlation of +27 becomes +4 
when corrected for this imbalance 

Some additional preliminary data are available which suggest the 
stabihty of these correlations The same photo rating task was admimstere 
by 15 male and 3 female expenmenters to a total of 57 subjects, 40 females 
and 17 males All these interactions were recorded on sound film and then 
rated by three observers for just the preinstniction-reading penod on the 
dimensions hsted in Table 4-7 The right side of the table gives the corre- 
lations Male expenmenters were judged more fnendly and pleasant as 
before With one exception, the correlations between the sex and behavior 
of the expenmenter were similar to those obtained from the analysis of 
Haley’s data That exception was the variable of pleasantness of voice, 
which in this replication was reversed in sign though very small in magni- 
tude Since in this study only 16 df were available, only two of the correla- 
tions reached even the 10 level of significance 

From the results of both these studies it seems reasonable to conclude 
that, either by asking the subjects themselves or by asking observers who 
were not participants in the experiment, the behavior and manner of experi- 
menters are associated with their sex For the person perception task em- 
ployed, and when interacting primarily with female subjects, male 
expenmenters behave m a more fnendly, personaUy involved, and physically 
active manner Since two of the three observers who rated the expenmenters 
were themselves females, this conclusion must be tempered by the possi- 
bihty that female subjects or observers are biased to perceive male expen- 
menters m the direction indicated 

For the 18 expenmenters and 57 subjects whose interactions were 
recorded on film, there were consistent differences m the way expenmenters 
were judged to behave when their subjects were males (N = 17) as com- 
pared to females (N = 40) For the preliminary data now available, the 
mstniction-reading phase of the interactton was rated by one group of ob- 
^ but not hear the sound track An- 

rnitiH ~ heard the sound track of the films but 

sL ofT ’'I Table 4-8 shows the correlations between the 

ior I ' o' “>0 experimenter separately 

hut^m sefiti™” "0‘ ''0=“' and those who could hear 

but not the interaction between expenmenters and subjects Of 17 rat- 
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TABLE 4-8 


Video and Audio Channel Ratings of Experimenters 
and Sex af Subject 


OBSERVATION CHANNEL 


Ratings 

Liking 

Friendly 

Pleasant 

Encouraging 

Honest 

Relaxed 

Median 


Video: 

-.29 

-.21 

-.33 

-.30 

-.33 

-.32 

-.31 


Audio: rpi^ 

-.39 

-.35 

-.29 

-.31 

-.26 

-.21 

-.30 


ings that could be made under both condiUons, 6 showed “ ^ 

-t-^20 or lareer under both conditions of observation. In evep' one of 

of observation, and the numerical values a^eed tone of voice^ 

looking at the “pkas'nJSy. encouraging, honest’, 

experimenters were more liKaoie, pic j enntactine male 

and relaxed when ^ould probably have been 

subjects. The absolute size of the division of male and female 

larger if there had been a reliability of the observers’ 

subjects (50:50 rather than 70.30) kuuv nf the video variables 

jud^ents had been higher. The median reliabil y Corrected for 

labS^ted was only .37 and of the eZiion be- 

re^sts^; ^Ta‘:!dr:ra:r^td^ .0 median eorrela. 

experimenters and subjects it ‘ Icast^when the subjects are 

warmly than do female expenm . , 1 . experimenters behave 

primarily females. In f 

more warmly toward their femal ^ by 

molecular observations (e.g., gla gt I support these con- 

Neil Friedman and Richard Katz. B!"'”!; ‘"t, fcrale^perimenters. 
elusions with one ""P"°"_^" 3 *'^heir subject? than did male experiment- 
at least sometimes, smiled more a behavior of the sex of the 

ers. The results for the efiect on expenmenter behavior 
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subject contacted, however, are sufficiently stable to warrant retention of 
the conclusion that in the psychological experiment, a certain degree ot 
chivalry is maintained 

Withm the past few years a number of investigators have pointed 
out the interacting effects of experimental vanables and the sex of subjects 
(Carlson & Carlson, 1960, Hovland & Jams, 1959, Kagan & Moss, 1962, 
McClelland, 1965, Sarason, Davidson, Lighthall, Waite, & Ruebush, 1960) 
Both simple, across the board sex differences and interacting sex differences 
may have multiple sources, including those that are genetic, morphological, 
endocrinological, sociological, and psychological To this list must now 
be added the variable of differential treatment of male and female subjects 
An experunent employing male and female subjects is likely to be a 
different experiment for the males and for the females Because experiment- 
ers behave differently to male and female subjects even while administering 
the same formally programmed procedures, male and female subjects may, 
psychologically, simply not be in the same experiment at all In order to 
assess the extent to which obtained sex differences have been due to differ- 
ential behavior toward male and female subjects, it would be necessary 
to compare sex differences obtained in those studies that depended for their 
data on a personal interaction with the subject and those that did not It 
would be reassuring to learn that sex differences obtained in a personal 
interaction between experimenter and subject were also obtained in mailed- 
out questionnaires and in experiments in which instructions to subjects 
were tape recorded and self-administered In Part III such methodological 
implications will be considered m detail 


Experimenter’s Age 

As in the case of the experimenter’s sex, the age of the experimenter 
can be readily judged, and fairly accurately, by the subject There has 
been less work done to assess the effects of the experimenter’s age on 
'he case for experimenter’s sex What 
aoe suggests that, at least sometimes, the expenmenter’s 

out hv Ph ^ response One recent investigation was earned 

nn^t i' Their analysts was of data collected 

to four ml." 'T'’ g'rts and included the girls’ responses 

to exal t 1 Tr One of these quelions, 

IZZ ’ " P™"™ of a picture ot a group of girls m 

parent 71 ’ "" onelf the girl’s 

Trl’s Ipfns wonM h J«Pondent was to say what that particular 

queshons could be coded7 ITteh^Tev'”" llh" ‘T 

or unacceptable by parental standard ^ 

The interviewers m this survey were all women, primanly of middle- 
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class background, and ranging in age from the early twenties to the late 
sixties The most dramatic effects of the interviewers’ ages were found to 
depend on the subjects’ ages Among respondents aged 15 or younger there 
was only the smallest tendency for younger interviewers to be given more 
“unacceptable” type responses Interviewers under 40 received 6 
more such replies than interviewers over 40 Among the older girls, howeve , 
those over 15, the younger interviewers evoked 44 percent more "“accep 
able responses than did the older interviewers It was the older girls then, 
who were more sensitive to the age differences 

perhaps, felt relatively freer to say “unacceptable things ^ 

to themselves in age In the case of interviewer s age, then, the effects were 
foulirnot t^be s^ple but rather interactive Often, as we saw earlier in this 
chapter, the effects of experimenter’s sex were similarly interactive rather 

thansimpk^uit^ lUSt now reported tell us of the relationship between a 

data collector’s age and the subjects’ responses, but 

whether it is the age per se that makes the difference Older interviewers 

I* , ™ M e"* 

score as more ascendant msumaoiy uu» thf* interview The 

response required is a put particularly so when the 

of the data collector makes some difference o p r ^ 

age of the subject is under 40 than to interviewers 

percent more trank responses to, ^ percent 

over 40 However, among r^pondents ov interviewers Corn- 

more trank responses tor the younger female subjects, when 

binmg male and ^-ale .nten,,ev.m and 
both participants are over 40, a 
less likely to occur 

Experimenter’s Race 

The skin color of the though 

the subject (Cantnl, ^ i’cantnl 1945) Some of the 

sponses are equally susceptible C 
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evidence for the survey research situation is provided by Hyman et al 
(1954) Just as older interviewers tended to receive more “proper or ac- 
ceptable responses from some of their subjects, so did white interviewers 
receive more proper or acceptable responses from their Negro respondents 
than did Negro interviewers The data cited were collected during World 
War II Half the Negro respondents were interviewed by white, half by 
Negro, interviewers One of the questions asked was whether Negroes would 
be treated better or worse by the Japanese in the event they won the war 
When interviewed by Negroes, only 25 percent of the respondents stated 
that they would be worse off under Japanese than under Amencan rule 
When interviewed by whites, however, 45 percent stated that they would be 
worse off under Japanese rule (p < 001) When interviewed by whites, 
only 1 1 percent of the Negroes stated that the army was unfair to Negroes, 
but when the interviewers were Negroes, 35 percent of respondents felt the 
army was discriminatory (p < 001) 

Additional evidence of this type is presented by Summers and Ham- 
monds (1965), who also present some interesting data of their own Their 
data, complementing the Hyman data, suggest further the interacting nature 
of the skin color of the experimenter and the skm color of the subject 
In their survey research, the respondents were white and were contacted 
y a research team consisting sometimes of two whites and sometimes of 
one white and one Negro The quesUonnaire was concerned with racial 
prejudice When both investigators were white, 52 percent of the respond- 
en s showed themselves to be highly prejudiced When one of the mvesti- 
f n percent were equally prejudiced These results 

m wnfm ^ ^ ® remarkable for the fact that subjects responded 

the “nronpr” 3s Negro respondents were shown to say 

resnondcntc ^ white interviewer, so too did white 

respondents say the right” thing more often to Negro data collectors 

of the suhie^rV'^^ff ^ interacts with other characteristics 

Inds sMv In the Summers end Ham- 

a greater sen’s, t.vity tTthTfaee orIrd*r'’"i? 
was below $5,OOof 17 percent o/th 

of racial prejudice when one ex,!^ decreased their stated degree 

father's meoL was over Ts 'P < 

respondents claimed less prejureL < onst“wt'^ 

over $10,000 there was*^a ir ^ When father’s income was 

(P< 005) 

and social sensitivity seem bettertauZ 

Irend appears when church attrnHa learned The same 

When e'h'nreh atmndancTis 

decrease in admitted racial prejudice ’wheL m ^ 

church attendance is moderate, 21 peSint e 

’ percent {p 05) show a decrease 
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of prejudice, and when church attendance is very regular, 44 percent 
(p < -001 ) show sensitivity to the race of the experimenter. In this case, 
the lessons of the church seem to be the same as the lessons of the social 
class. 

Even when the response investigated is physiological, the race of the 
experimenter may affect that response. Rankin and Campbell (1955) 
showed that the galvanic skin response showed a greater increase if the 
experimenter adjusting the apparatus was Negro rather than white. More 
recently, Bernstein (1965) reported that basal skin impedance (measured 
in kilohms) was higher when the experimenter was white rather than 
Negro regardless of the race of the subject. In general, the effect of 
experimenter’s race on subjects’ physiological responses is poorly under- 
stood and, up to the present, little studied. 

A number of studies are available which suggest that performance 
on various psychological tests may be affected by the race of the experi- 
menter. Employing a test of expression of hostility, Katz, Robinson, Epps, 
and Waly (1964) carried out just such a study employing a white and 
Negro experimenter. Half the time the Negro subjects had their task 
structured as an affectively neutral research procedure, and half the time 
the task was structured as an intelligence test. When the task was presented 
as a neutral one there were no significant effects of the experimenter’s race 
on subjects’ hostility scores. However, when the task was structured as an 
intelligence test, significantly less hostility was obtained when the experi- 
menter was white (p < .01), The authors’ interpretation of this finding 
was that Ncgioes tended to control their hostility more when, contacted by 
a white rather than a Negro experimenter. This interpretation is very much 
in line with that implied by the data from survey research studies in which 
Negroes gave more “proper” responses to their white as compared to 
Negro interviewers. 

When the tests really are tests of intellectual functioning of various 
kinds, the race of the experimenter also has its effects. Thus, Katz and his 
co-workers describe an experiment in which the task was similar to one 
of the subtests of standard tests of intelligence, in this case digit-symbol 
substitution. When the task was structured as a test of coordination, the 
Negro subjects performed better for the white than for the Negro experi- 
menter. It was as though the subjects were unwilling to demonstrate their 
“good sense of rhythm” to the Negro but quite willing to demonstrate it for 
the white experimenter who might, in their eyes, have expected it. When the 
same task was structured as an intelligence test, performance was relatively 
better with the Negro than with the white experimenter. Perhaps again these 
subjects were doing what they perceived to be the socially appropriate 
thing — in this case performing not so brightly for the white experimenter. 

There are, too, studies that showed no effects of experimenter skin 
color on subjects’ intellectual performance. In the same study described, 
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for example, Katz and his associates found no effects of the expenmenter s 
race on the adequacy of subjects’ concept formation Other examples o 
negative results are given by Canady (1936) and Mashng (1960). 


Experimenter’s Religion 


The experimenter’s rehgion as a vanable affecting subjects’ responses 
has been investigated primarily in the area of survey research Hyman and 
his collaborators (1954) give us one example In 1943, over 200 subjects 
were interviewed by Jewish and Gentile data collectors who asked whether 
Jews had too much, too little, or the nght amount of influence in the business 
world Of the Gentile subjects contacted by Gentile interviewers, 50 percent 
felt that Jews had too much influence When the interviewers were Jewish, 


however, only 22 percent thought so Once again the respondents seemed 
to have said the right thing One caution in the interpretation of these data 
was advanced by Hyman et al In this study, interviewers were free to pick 
their own respondents within certain limits, so that Jewish interviewers 
might, perhaps unwittingly, have chosen more sympathetic Gentile re- 
spondents 


Robinson and Rohde (1946) varied both the appearance of Jewish- 
ness and the Jewishness of the interviewer’s name m their study of the 
effect of perceived rehgion of the interviewer on the extent of anti-Semitic 
responses in pubUc opinion research When interviewers neither looked 
Jewish nor gave Jewish names, about 23 percent of respondents felt 
that Jews had too much power When the interviewer was Jewish-appeanng 
ut di not give a Jewish name, about 16 percent of subjects felt Jews had 
too much power When the interviewer looked Jewish and gave a Jewish 
n^e, only 6 percent of respondents felt Jews had too much power In 
. 1 / n j ^ s^^ples assigned the different types of interviewer were 

e mac s , so t at the results are more likely due to the respondent’s 
of Z Tt n" ‘t'an to a selection bias on the part 

nf PTnpr ^ ^ ector Unlike the situation described earher when race 
who ^ ^ vanable it was the lower economic status subjects 

who were more sensitive to the religion of the investigator 

attnbmes''of tlT'' H ‘’a™ biosocmf ^ 

has come from h ™ f™” ^'■•’jects 

hrsbLTno,rH , h H 'P‘'“ "“tural enough as 

has been pointed out by Hyman et al (1954) and by Mosteller in a oersonal 
communication (1964) In that ti. “y ™osteller in a personal 

larce enouah to f ’ numbers of data collectors are 

4fh or win m ^ evaluauon of mterv.ewer difierenees 

r the n7e™ “ \ ^P^cfie attnbutes 

m survey 7e!* n r '' " 'he effects obtained 

in survey research of various expenmenter attnbutes would not hold in 
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such other data-collecting contexts as the laboratory experiment. Particu- 
larly for the variables of experimenter age and religion, however, there is 
little direct evidence to date that they operate in the laboratory as they do 
in the field. 

The general conclusion to be drawn from much of the research reviewed 
here seems to be that subjects tend to respond in the way they feel 
to be most proper in the light of the investigator’s attributes. That subjects in 
experiments as well as respondents in surveys want to do the right thing 
and want to be well evaluated has been suggested by Orne (1962), Riecken 
(1962), and Rosenberg (1965). 

Before leaving the general topic of the biosocial attributes of the 
experimenter as determinants of subjects’ responses, it would be well to 
repeat a caution suggested earlier. There is no way to be sure that any of 
the effects discussed so far are due to the physical characteristics of the ex- 
perimeter rather than to some correlated variables. In fact, it was found 
quite likely, especially for the variable of experimenter’s sex, that experi- 
menters differing in appearance also behave differently toward their sub- 
jects. It could be this behavioral variation more than the variation of 
physical attributes that accounts for the effects on subjects’ responses. 


MLSU - CENTRAL LIBRARY 



5 


Psychosocial Attributes 


The expenmenter attnbutes discussed m the last chapter were all 
readily assessable by inspection The expenmenter attnbutes to be discussed 
now are also readily assessable, but not simply by inspection The anxiety 
or hostility of those expenmenters functioning well enough to be expen* 
menters at all must be assessed more indirectly, sometimes by simply asking 
the expenmenter about it, more often by the use of standard psychological 
instruments 


Expcrimcnter^s Anxiety 

Wmkcl and Sarason (1964) have shown that the anxiety level of 
the expenmenter may interact complexly with subject vanables and with 
cxpcnmental condiuons m determining the verbal learning of the expen- 
memal subjects They employed 24 male expenmenters, all undergraduates, 
a of whom scored high on a scale of test anxiety and half of whom scored 
ovi ^bjccts were 72 male and 72 female students of introductory psychol- 
Half the subjects scored as high-anxious and half as low-anxious Re- 
fi*fT* ^ *1131 when the expenmenters were more anxious there was no 

etween male and female subjects m their performance on the 
^3sk However, when the experimenters were less anxious, 
the exMn better than males The optimal combination of 

"h.chrTl" '? that m 

experimenter I ° low-anxious female in eontact with a low-anxious 
the” Th, " was better than in any of 

interaction which imotM 1 ^’ m"’’" >>y Iho shll higher order 

gi'cn the subieets When the'" of the type of instructions 

IS auxicty. lust as in in,- experimenter attribute under investigation 

Interactions tend to *=*penmentcr's sex, extremely complicated 

ons tend emerge if the expenment allows for their assessment 
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Sarason (1965) describes an unpublished study by Barnard (1963) which 
showed that degree of disturbance of the experimenter as determined from 
a phrase association task was a predictor of the subjects’ degree of distur- 
bance in the same task. 

When the task is the interpretation of ink blots rather than the learmng 
of verbal materials, the anxiety level of the experimenter as defined by his 
own Rorschach responses also makes a difference. More aimous experi- 
menters obtained from their subjects Rorschach responses interpreted as 
more hostile and more passive than the responses obtained by expenmenters 
judged less anxious. In addition, the more anxious expenmenters oWmned 
from their subjects more fantasy material and a higher depee of judged 
self-awareness (Cleveland, 1951; Sanders & Cleveland, 1953). 

When the task involved memory for digits, a subtest of many standard 
tests of intelligence, the degree of “adjustment” or anaety of the expen- 
menter affected subjects’ performance (Young, 1959). The measure of 
justment, a variable correlated generaUy with 

Worchel Self Activity Inventory admimstered to ^ . F 

students. These students then served as expenmenters 

digit span test to their peers. Subjects who were 

poorly adjusted experimenters performed better a e ,( pf jjjjj 

^ . *oV>ioc Tf nnvthin? the more anxious experiment- 

variables or instruction vanables. If anytmng, mem r 

ers tended to obtain less adequate jnore neurotic 

their subjects in a learning (or perhaps ad- 

safe to conclude that the expenmenters anxiety leve t p y 

justment level) may affect subjects i of our current 

the nature of the effect is not predictable on the basis oi o 
knowledge. This conclusion is borne out by the results of the two expen 

ments reported next. described earlier which required 

In both studies, 7” „ f ‘(‘‘pTopU pictu in photographs, 

subjects to rate the success or fa P py anxiety level 

In both experiments, ‘h' pj Anxiety. In one of these 

defined by the Taylor (1953) Sea nhntn ratine task to 230 

studies 40 experimenters “‘'™"'7aif females'^ In this study more anxious 

subjects, half of whom ,he photos they asked 

experimenters obtained higher rati g 4 . 48 n = .02 (Rosenthal, 

their subjects to rate. The ^"“''°963). I^’the other experiment, 26 
Persinger, Vikan-Klmc, & Mury, . , ratine task to 115 female 
experimenters administered the same photo rating 
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..hjcts In th.s expenment, .t was the less anxious expenmenters who 
Jsmei higher ratings of the suceess of the photos *ey Presented to ttor 


cMaincd nigncr raimgs ui uic w*. w.w ^ vnhn 

suhicets The correlation this time was — 54, p < 01 (Rosen , . 

Greenfield, i Carota, 1965) Final evidence for the complexity 
rchtionship between expenmenter*s anxiety and subjects ^ 


renuonsmp uciwccu cApciiiU4.iii«.i j * 

from a stud) of verbal conditioning (Rosenthal, Kohn, ^reentie , 
Carota, 1966) In that expenment 19 male experunenters conducten 
\crbil reinforcement procedures with 60 female subjects Sentences wer 
to be constructed by the subjects and each sentence was to begin wit any 
one of SIX pronouns (Taffel, 1955) Whenever first-person pronouns were 
selected the expenmenter said the word “good ” The increase in the usage 
of first-person pronouns from the beginning to the end of the expenmen 
was the measure of verbal conditioning This time the high- and low-anxious 
experimenters did not differ from each other m the degree of verbal con 
dilioning shown by their subjects However* both high- and low-anxious 
experimenters obtained significantly more conditioning than did those ex- 


penmenters who scored as medium-anxious (p = 08) 
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Mulry. Analysis of these data showed more anxious experimenters to be 
rated more shy [r = +.23, p = .06] by their subjects during an experiment 
involving motor performance.) From the evidence presented, this con- 
steliation of experimenter behavior seems sometimes to increase, sometimes 
to decrease, and sometimes not to affect the subjects’ performance at all. 
To make a notable understatement: more research is needed— much more. 


Experimenter’s Need for Approval 

Crowne and Marlowe (1964) have shown that the need tor social 
approval as measured by their scale (the Marlowe-Crowne Social Des.r- 
aMity Scale) predicts cautious, conforming, and persuasible behavior in a 
variety of experimental situations. UntU recently only “subjects had been 
administered this instrument, but now there are a few studies that have re- 
lated the “experimenter’s” need for approval to his subjects responses i 
various experimental situations. Mulry (1962), for example, employed 12 
male experimenters to administer to some 69 

requiring perceptual-motor skill. A number of tests, including the Marlowe- 
Crowne SD Scale, were administered to the 

tendency for experimenters scoring higher on the “ed for approva to ob 
tain superior performance on the pursuit rotor task. Expenmenters h.^e 
in the Led for approval obtained Performance from thei 

male subjects when the experimenters had been led to believe that y 

themselves were good at a pursuit rotor task. 

TTie unpreditability of the effects of the axpenmenter s a^iety on h. 
subject’s responses is matched by the unpredictabihty o ‘^e ‘ 

expirimenterL need for approval. Thus, in one ^’‘P" ™ 
person perception task ®arh"^ experimen^^^^ successful people, 

approval obtained ratings of the Pj”'” ^ J Persinger, Vikan-Kline, & 

The correlation was —.32, p — -10 w was exoeri- 

Mulry, 1963). In another experiment also 

menters higher in need for approwl Greenfield, & 

That correlation was +.38, p - • ( obtained sim- 

Carota, 1965). Within a single experimenters 

ilarly unpredictable relationships. He p y ctqndard oerson per- 

andLx Laic experimenters 

ception task to subjects. Ainong m P , „,in„s of “success” 

tween their need for approval ^ analogous correlation was 

was -.27. Among “/“gh not rignl^antly different from 

+.43. These 3 sample sixes, do suggest that the 

zero, nor from each other for suen p exocrimenter attributes as 

sex of the experimenter may internet with such experi.nen 

need for approval to affect the subje^ rcspon nmenter’s need for 

In one of the expenments cited carlie , p 
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approval was not related to the subject’s susc^tibility to 
toreements of the expenmenter (Rosenthal. Kohn, Greenfield & Car^ 
1966) In that expenment, however, each experimenter was rated by each 
of his subjects on his behavior dunng the mteraction with that subject Al- 
though the anxiety level of the expenmenter was found to be unrelated ^ 
any of the subjects’ ratings, that was not the case for the expenmenter s 
need for social approval Table 5-1 shows the correlations between subjects 


TABLE 5-1 


Experimenter's Need for Approval and Experimental 
Behavior as Seen and Heard "Subjectively" 


Behavior 

Correlation 

P 

Persona! 

-32 

02 

Loud 

-27 

05 

Enthusiastic 

+ 27 

.05 

Talkotive 

-22 

10 

Likable 

-22 

.10 


raUngs of their experimenters and the experimenters’ need for approval 
The pattern of correlauons obtained apparently did not affect the subjects’ 
responses in this expenment on verbal conditioning But presumably where 
a quieter, more enthusiastic but less likable experimenter would affect his 
subjects differently, we would expect the expenmenter’s need for approval 
to affect his subjects by way of these different behaviors That experimenters 
higher in need for approval should be less well liked is predictable from the 
work of Crowne and Marlowe (1964) However, that they should be less 
personal does not seem to follow from what is known of the need for ap- 
proval If anything, these expenmenters should try too hard to be friendly, 
thereby becoming less popular with their subjects 

i.on. uU,? P"''""nary analysis of the filmed interac 

Uonal businKs'^Th""''""'* transact their preinstruc- 

rfaled lo "«<l for approval was not found to be 

Tound t rack WU ">=«*<= of the" films without benefit of the 

onW three vamh " 'T" “"d auditory cues, 

approv "> ‘"e experimenters’ uLd for 

more ciprcsswe face (r “PP'o^al were judged to have a 

-1-44, p = 071 f' P — be)- to smile more often (r = 

subjects (r = -u'jo „ "'“'■o 'o tho direction of their 

’ P lU) (Ratings of these last two variables were 
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made available by Neil Friedman and Richard Katz.) These findings are 
just what we would expect from the person higher in need for approval 

(Crowne& Marlowe, 1964). , 1 . . ■ ij j ,i,„ 

It was the observations made of the sound track alone that yielded the 
most interesting information.^ Table 5-2 shows the larger correlations be- 

TABLE 5-2 


Experimenter's Need for Approval and Experimental 
Behavior as Heard "Objective!/' 

Behavior 


Personal 
Friendly 
Dominant 
Speaks distinctly 

Expressive-voiced 

Active 

Likable 

Enthusiastic 

Pleasant-voiced 


Correlation 

P 

+ .57 

.02 

+.47 

.05 

+ .46 

.05 

+ .46 

.05 

+ .45 

.06 

+ .41 

.10 

+ .40 

.10 

+ .39 

.10 

+ .39 

.10 


tween experimenter’s need for appr-al -d ra^ngs by the^”^^^^^^^ 
servers-le., those who with 

These “tone-of-voice vanables part y p ^ different task 

by subjects themselves in a differen e p ^ j approval were 

,U' 5 ..,. I. Ml. M 

judged as more enthusiastic. In personal and less likable, 

ever, subjects found these ^P'^^J^^pPdent judges of the experi- 
whereas in the photo-rating , 3 ^^ more likable if they were 

menters’ tone found ‘>’em more P acknowledge the consistencies 

higher in need for approval. f 5 The two experiments dillered m 
but difficult to account for the samnles of experimenters, and the 

the nature of the experimental The subject of the 

type of judgments ^ “^he experimenter and may observe things 

experiment is closer physically ^ of the motion picture or sound 

not observable by the . imeracUng subject is much busier than 

track record. On the other han , completely to the experimenter s 

the “objective” observer, who 

= Th= same pa.lem / .tush fe«r c( the corxelMions reached 

the instruction-reading period 
the .10 level of significance. 
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behavior without having another task of his own to perform A reconcilia- 
tion of the differences is possible if we can assume that to be judged personal 
and hkable from the tone of voice alone is not at all the same thing as to be 
judged sunilarly on the basis of all available sense modalities What does 
seem clear is that experimenters higher or lower in need for approval are 
likely to behave differently in interaction with their subjects Sometimes, but 
not always, this differential behavior is likely to affect the subject’s response 


Experimenter’s Birth Order 

The order of birth within the family is not, m the usual sense, a psy- 
chological vanable It is not defined m terms of the subject’s behavior ex- 
cept in the narrow sense that it is usually the subject’s statement of his 
ordinal position, which is used as the operational definition of the vanable 
Since Schachter’s already classic work (1959), birth order has been investi- 
gated by many workers and has been shown to bear significant relationships 
to other, more “properly” psychological vanables 

One experiment shows that for the person perception task described 
earlier, firstborn experimenters tend to obtain higher ratings of the success of 
persons pictured in photos than do later-bom experimenters = 5 85, 
p= 02, Rosenthal, Kohn, Greenfield, & Carota, 1965) Another ex- 
periment, however, the one employing the verbal conditioning procedure, 
showed no effects on subjects performance of the experimenter’s birth 
order (Rosenthal, Kohn, Greenfield, & Carota, 1966) In that study, it 
may be recalled, subjects made judgments of their expenmenter’s behavior 
dunng the experimental transaction Table 5 3 shows the correlations be- 
tween these ratings of the experimenter’s behavior and his birth order The 
general picture that emerges is that, as experimenters, firstborns are faster 
more reluctant speakers, employing fewer body and facial movements 


TABLE 5—3 


Experimenter's Earlier Birth and Behavior in a Verbal 
Conditioning Experiment 


Be/iovior 

Talkative 
Slow-speaking 
Body activity 
Trunk activity 
Hand gestures 
Expressive face 


Corre/ation 

P 

-37 

006 

-32 

02 

-32 

02 

-27 

05 

-26 

05 

-24 

08 
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and expressions, than their later-bom counterparts In this verbal coni- 
Uonine experiment, this combmation of charactenstics differentiating first- 
^ fmm kter-bom experimenters appeared to have no effect on subjects 

responses, in other experiments it might 

In the expenment by Mulry (1962) already cited, ^ 
tionship between the birth order of the experimenter and the motor per 
formance of his subjects An analysis of the ratings these subjects made of 
“elemers,'however. shoLd that firstborn ^in- 
differently dunng the f 05) and more de- 

menters were rated ,,i„,h seems consistent with 

fensive (r = -)- 22, p - 07) than la somewhat more 

ItdCdiotlci^cLrolled people i'; 

however, revealed that This is directly opposite 

l^rrLiTshVirrtld inibl: 5-3 and is - 

fact that Mulry’s task was -"“Wr whik J expenmenter could 

A third expenment in which the brth order 01 

be correlated with his behavior ‘'“"”8 ^ expenment there was no 

person perception which had been m P^^ 

relationship between ®’'P^"‘"®‘{,"fa<.ito be judged However, dunng 
cess perceived by his subjects in ’ firstborn expenmenters 

the instruction-reading phase of ^ officiously than later-bom 

were seen and heard to behave “relations Observations 

experimenters Table 5-4 ^^ows the reW cone^tm^^^^^ 

made dunng the brief j r though the correlations based on 

lated with the “penmenter s birth > mstrucUon 

that phase were all in the same i opposite in direction to those 

penod The results shown in 1 able o-t i-r 


TABLE 5—4 


Experimenter's Earlier Birth and Behavior in 

Perception Experiment 


a Person 


Behavior 


Correlation 


Hand gestures 
Body activity 
Head activity 
Arm gestures 

Important-acting 


+ 50 
+ 48 
+ 47 
+ 41 
+ 41 


P 

05 

05 

05 

10 

10 
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obtained m the verbal conditioning study (Table 5-3) It cannot be said 
whether the difference is due to the different tasks employed m the two 
studies or to the fact that the observers m the one case were the subjects 
themselves rather than external observers ot sound motion pictures As for 
the variable of talkativeness which yielded opposite relationships m the 
verbal conditioning and the motor performance expenments, it was not sig- 
mficantly related to birth order in the filmed study We are left with the un- 
satisfying conclusion that the birth order of the expenmenter only sometimes 
affects the responses he obtains from his subjects, that more often his birth 
order is related to his behavior in the experimental interaction, and that the 
nature of this behavior seems to interact at least with the type of experiment 
he IS conducting 


Experimenter’s Hostility 


The work of Sarason (1962) and of Sarason and Minard (1963) has 
already been cited m connection with the effects of experimenter’s sex It 
will be recalled that greater hostibty of the experimenter was predictive 
of obtaining more hostile verbs m a sentence construction task (Sarason, 
1962) This was especially the case when the subjects, too, tended to be 
more hostile Among experimenters scoring low m hostility, those subjects 
scoring high in hostibty emitted 9 percent fewer hostile verbs than did sub- 
jects sconng low in hostility Among expenmenters scoring high in hos- 
tihty, those subjects scoring high m hostility emitted 17 percent more 
hostile verbs than did subjects sconng low m hostility The interaction was 
significant at the 05 level 


When the experimenters reinforced subjects’ use of first-person pro- 
nouns by saying "good,” the hostility level of the expenmenter was again 
ound to make a difference, this time by affecting the increase in the use 
of the reinforced responses from earlier to later trials Actually, it was the in- 
teraction of experimenter’s hostibty and his ascnbed prestige that led to the 
dramatic effects obtained (Sarason & Minard, 1963 ) The increase m the use 
of the reinforced responses was only 4 percent when the expenmenter was 
prestige and only 5 percent when he was high 
1 y an ow m prestige The increase, however, was 47 percent 
when the experimenter was htgh in both hostility and prestige, and it was 

fom'’n,r r T “d Onee again the 

resumes r -P<=nmenter attributes on Ljects’ 

Additional evidence is presented by Sarason (1965), who cites the un- 

UhW to^rV' f administered a test o£ hos- 
s ho . I “'I t°“nd that subjects contacted 

by less hostile expenmenters showed a greater degree of disturbance on a 
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phrase association test than did subjects contacted by more hostile experi- 

importance of distinguishing between “vert and covert hostmty lev- 
els of experiLnters has been made clear by the work of S“dem 
land (1953) Nine graduate students in psychology 

sti!” = A'. .■ 

defined in terms of subjects’ ratings of „ 3 es. Sub- 

was defined in terms of the experimen er exoerimenters were high 

jects’ responses reflecting experiLnters were high on 

on covert hostility but decreased intimidated their 

overt hostility. Overtly hostile expenmenters m^ 

subjects into giving more P. ^ expression of hostile responses, 

menters may “Lws Umel information on the actual 

What seems especially ^ or low in hostiUty-behavior 

behavior of expenmenters ctandards for the appropriateness of 

that presumably creates quite different standards form pp 

subjects* responses. 


Experimenter’s AuthorifarianUm 


• C c,-.1p Pesev Cook-Marquis (1958) 
On the basis of the California J ’ ^^o^were high-authoritarian, 
obtained groups of expenmenters an * administered tests of 

low-authoritarian, and acquiesce . P ,j,gse problems was not 

problem solving to their subjects. ® attitudes toward dif- 

related to experimenter personal! y. ^ found that high-au- 

ferent forms of teaching methods influencing these attitudes 

thoritarian experimenters were es nrauiescent experimenters. The in- 

than were the low-authoritarian or \ ^ ^th which it seems easy 

terpretation given these results by ^ themselves believe in un- 
to agree, was that high authonianans therefore less convincing 

structured teaching techniques an ^ more of these techniques. ^ 

in trying to influence their subjects to pp connection with 

tL work of Mulry (1962) hfs ,,p„toent, employ- 

the need for approval and birth . enters had also been assessed 

ing the pursuit rotor task, his ”P'”„„in F Seale. Authoritarianism 

for authoritarianism by the use o . fining subjects’ perceptual-mo or 
of the experimenter was a factor ■■'."^"iimenter’s belief about his 
performance only in interaction vn experimenters who were ow in 

own ability at the pursuit rotor tas * at the pursuit *'°*°*’ 

authoritarianism and who felt thems subjects compared to the 

task obtained superior performan y.^ontarianism and pe^ption o 

other combinations of expenmen c administered to their su jec s. 

their own adequacy at the motor 
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obtamed m the verbal condiUomng study (Table 5-3) It cannot be s.d 
whether the difierence is due to the different tasks employed m fte to 
studies or to the fact that the observers in the one case were the subjects 
themselves rather than external observers of sound motion pictures As or 
the variable of talkativeness which yielded opposite relationships m the 
verbal conditioning and the motor performance expenments, it was not sig- 
nificantly related to birth order in the filmed study We ate left with the u - 
sausfying conclusion that the birth order of the expenmenter only so”®''™® 
affects the responses he obtains from his subjects, that more often his but 
order is related to his behavior m the experimental interaction, and that the 
nature of this behavior seems to interact at least with the type of expenment 
he IS conducting 


Experimenter’s Hostility 

The work of Sarason (1962) and of Sarason and Minard (1963) has 
already been cited m connection with the effects of expenmenter’s sex It 
will be recalled that greater hostdity of the expenmenter was predictive 
of obtaining more hostile verbs m a sentence construction task (Sarason, 
1962) This was especially the case when the subjects, too, tended to be 
more hostile Among expenmenters scoring low in hostility, those subjects 
sconng high m hostility emitted 9 percent fewer hostile verbs than did sub- 
jects sconng low m hostility Among expenmenters sconng high in hos- 
tility, those subjects scoring high m hostility emitted 17 percent more 
hostile verbs than did subjects sconng low in hostility The interaction was 
significant at the 05 level 

When the experimenters reinforced subjects’ use of first-person pro- 
nouns by saying ‘ good,’ the hostihty level of the expenmenter was again 
found to make a difference this time by affecting the increase m the use 
of the reinforced responses from earlier to later trials Actually, it was the in- 
teraction of expenmenter s hostility and his ascnbed prestige that led to the 
dramatic effects obtained (Sarason & Minard, 1963) The increase in the use 
of the reinforced responses was only 4 percent when the expenmenter was 
low in hostility and high in prestige and only 5 percent when he was high 
in hostility and low in prestige The increase, however, was 47 percent 
when the experimenter was high m both hostihty and prestige, and it was 
52 percent when he was low m both hostihty and prestige Once again the 
complex nature of the effects of exf^nmenter attnbutes on subjects’ 
responses is demonstrated, and once again, the explanation is far from 
intuitively obvious 

Additional evidence is presented by Sarason (1965), who cites the un- 
published work of Barnard (1963) Barnard administered a test of bos 
UUty to both subjects and expenmenters and found that subjects contacted 
by less hostile expenmenters showed a greater degree of disturbance on a 
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Experimenters scoring higher in intelligence were rated by their subjects as 
morconsistent in their behavior (r = +.29, p = .02) and more phys.calty 
active as reflected in greater amount of body movements (r ^ 

!l0) In addition, subjects contacted by brighter -pe— ^ 
satisfied with their participation in the experiment (r - +• . P 

Experimenter’s Dominance 

Reference has already been made to the work of Ehrlich and Ri“man 

(1961). They had available scores oraLescLfgirls” Those 

earned by the interviewers employed in as y ._„aared more task- 
interviewers who were more ascendant an P different responses 

oriented, as defined by a scale of L this 

from their subjects than did the remiuni g , .... « reply. When 

study were defined in terms of the soeia ujaetivity, they obtained 

interviewers scored high on both ascen ance ^ interviewers scor- 

38 percent fewer socially unacceptable seem, 

ing lower on these scales. No-nonsense type interviewers are, 

more Ukely to draw no-nonsense ty^ responses.^^^^^^^^ dissertation by Sy- 

Sarason (1965) has summariz P j,y more dominant ex- 

mons (1964) which shows that ^ ,han L subjects contacted 

perimenters make more negative K - evidence that subjects con- 

by less dominant experimenters. T negative references to 

tacted by more dominant experimen experimenter’s dom- 

olher people. The correlation between “ f ^ JbjL’ rating other 

inance throughout an entire ^^P^'m®" qq 5 (This particular 

people as having experienced dealing with the communica- 

experiment is discussed further m t findings make tempting the 

tion of experimenters’ expectancies.) . ^ experimenters evoke more 

psychoanalytic interpretation that omi source, is 

hostility which, because it cannot be saie y ^ external scape- 

turned either inward, as in the Symons ® jj,g fact that in data 

goat. This interpretation is weakene * described as more “pushy” 

collected by Suzanne Haley, expenm successful rather than more 

tended to obtain ratings of other ® interpretation, 

unsuccessful as we would have pre i dominance derive from the ex- 

To the extent that these defimUons of domma 
perimenter’s behavior in the seems best postponed until 

chological instruments, their furt er * detailed consideration of other, 

the next section. There will be foun ® these variables, that o 

more fully social psychological varia related to the variable of expen- 
experimenter status, seems P=>ri' . .Aefiavior in the expenment. 
menter dominance as inferred fro 
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Although Muiry’s more authontanan expenmenters did not obtain sig- 
mficarnly dilerent La from their subjects (unless “"'f' ^ 

considerL simultaneously), their subjects were 

contact with them Thus, subjects contacted by more authoritarian expen 
menters described themselves as less satisfied with their participation m the 
expenment (r = - 27, p = 03) and as less interested in the 
(r = _ 23, p = 06) In addibon, the more authontanan expenmenters 
were judged by their subjects to be less consistent in their behavior dunng 
the expenment (r = - 27, p = 03) Though it did not seem to occur in 
this study, It seems reasonable to suppose that there are expenmen s m 
which expenmenters who thus affect their subjects’ reactions will obtain 
different responses from them in the expenmental task posed There are 


some data that suggest that this is so 

From the analysis of sound motion pictures of expenmenters adminis- 
tenng the person perception task, it has been found that expenmenters who 
are judged to be less consistent m their behavior tend to obtain ratings of 
the photos as of more successful people (r = — 35, p < 01) K more 
authontanan expenmenters are less consistent in their conduct of the per- 
son perception expenment, as they were m Muiry’s motor performance ex- 
penment, we would expect that more authontanan expenmenters would 
obtain ratings of photos as being of more successful people This prediction 
could be tested for only a small sample of six expenmenters who had been 
administered the California F Scale and who also conducted a person per- 
ception expenment descnbed in detail elsewhere (Rosenthal, Persmger, 
Mulry, Vikan-Kime, & Grothe, 1964a, p 467) The mean rating of suc- 
cess obtained by the three more authoritarian experimenters was -4-0 27 
and that obtained by the three less authontanan expenmenters was — 1 06 
The difference was significant at the 06 level (1 = 275) 


Experimenter’s Intelligence 

Perhaps because expenmenters, even ‘student expenmenters,” tend to 
be so highly selected for intelligence, there has been little effort expended to 
study the effects of expenmenters intelligence on subjects’ responses The 
restnction of the range of IQ scores found among a set of experimenters 
would tend to reduce dramaticaUy the correlation between their IQ and 
their subjects’ performance In the Mulry (1962) experiment, no relation- 
ship was found between the intelligence test scores of the expenmenter and 
his subject s perceptual motor performance There was a tendency, how- 
ever, for experimenters’ intelligence to interact with subjects sex m such a 
way that male subjects earned particularly high performance scores when 
their expenmenters scored lower on the Shipley-Hartford Test of intelli- 
gence Once again, subjects ratings of their experimenters were available 
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menter wasn’t very senous and furthermore, wasn-^t f “ ^ 

matter too much whether his verbal utterances of good "'em 
ously or not In this experiment 16 expenmenters were employ^ ^ 
eral Sarason and his collaborators have employed lerge samples 
extnmerrs “or the experimenter attribute of status, most of the relevant 
Ses are bLd on sample sizes of only two or three expenmenters Still, 

rjT4S5=..p:Sri=S?. 

The more prestigious expenmenter was more m generaUy, 

subjects’ responses This is j“^o^,ver, just as other vanables 

with the results of Sarason and Min 

were found to interact with expenmenter s a Pnesen (1960) em- 

find such interactions in the following nhoto judging task to 

ployed two military expenmenters to admim J to Ae subjects 

as officers, someUmes as enlisted m sometimes for 

subjects for bkmg the persons P*^ “ , . ciear-cut suggested that 

the officer-experimenter was more elt man-exnenmenter was more 

dishbng photographs, ®”}[king photographs That is a result 

effective at increasing subjects rate g P success 

simdar to the one found when P’’° “ drew more failure ratings The 
or failure and more dominant experi enlisted man One 

officer role seems a more dominant on , ggjjier, of the present 

plausible interpretation, related to that p p „ the officer to 

data IS that the recruit-subjects n,ade them feel aggressive 

be aggressive when his presence mig i exoenmenter-required con- 

Here, in a sense, was a chance to com When the experimenter 

formity with the subject-desired ®pg^ , ^5 ^gre, they may have felt 
was an enlisted man, as the subjects themsews^^^^^^^ 
more fnendly and, therefore, foun i jjjj experiment, the authors 

the persons pictured in photos In ' P expenmenters might have 

point out, the differences m status . ^-e both were staff members o 

been diminished in their subjects’ <=y« 

the high status organization carrying o . expenmenter s status 

In one expenment on verba interaction with the subject 

was defined in terms of his behavior d ^ 3 ,,):g_ jess noisy, and more 

It was assumed that a more / j a hiaher status by his subjects 

consistent expenmenter would be asc “good” whenever t e 

The 19 male experimenters of this ^ ^^1 ^ohn, Greenfield, & Carota, 

subjects used first-person pronouns ( . ’ „ ,he inerease in the use of 

1966) Table 5-5 shows the 

first-person pronouns over the course of the p 
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SOCIAL PSYCHOLOGICAL ATTRIBUTES 

The biosocial attnbutes of experimenters which have been discussed 
are, usually, immediately apparent to the subject The psychological attnb- 
utes discussed are not, usually, so immediately apparent to the subject, al- 
though as we have seen, there are often behavioral correlates of an 
experimenter’s psychological charactenstics In this section the discussion 
turns more fully to those attnbutes of the experimenter that are defined 
neither hy his appearance nor by hts answers to items of a psychological test 
or questionnaire Sometimes the definition of these social psychological 
attnbutes is directly and simply behavioral, as in the case of the attnbute of 
“warmth ” Sometimes the definition is only indirectly behavioral, as in the 
case of an experimenter’s status, and not at all simple, in the sense that the 
relative status of an expenmenter who is an army captain will be determined 
by whether the subject is an army pnvate or a major 


Experimenter’s Relative Status 


In most laboratory research the subjects are undergraduates and the ex- 
penmenters range m academic status from being advanced undergraduates, 
through the vanous levels of graduate students, aU the way through the 
vanous status levels of the faculty, from new Ph D to senior professor In 
military research settings, the status of the expenmenter in terms of absolute 
rank is immediately apparent to the subjects, though an additional source 
of status, as we shall see, may denve from the setting in which the research 
IS conducted This effect of the setting or of the sponsorship of the research 
IS well known to have an important influence m survey research (Hyman 
et al , 1954) Surveys conducted by the FBI are likely to earn a degree of 
cooperation quite different from that earned by a manufacturer of so-called 
washday products 


Regardless of how the expenmenter derives his relative status or pres- 
tige in the eyes of his subject, that status often affects not only whether the 
subject wiU respond (Norman, 1948) but also how he will respond An 
examp e o t is has already been given in the discussion of experimenter’s 
ostihty There we saw that the prestige of the experimenter interacted with 
his hostihty level to serve as a determinant of subjects’ susceptibility to 
verbal reinforcement (Sarason & Minard. 1963) Experimenter’s prestige in 
that experiment was defined in terms of formality of dress, of manner, and 
of request for participation Expenmenter’s prestige was found to interact 
^h another vartable-aeeess to visual cues from the expenmenter’s face 
men subjects could not see the expenmenter’s face and when he was in 
the low status condition, there was a decrease m the effect of his reinforce- 
ments on the subject’s responses Perhaps subjects felt that if the experi- 
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fonnity. That seems to be the case whether the etrperimenter-s state is 
defined in terms of such external symbols as dress or '“‘f 
status-earning behaviors during the interaction with the subjech This con 
c5^:::n s™te consistent also with the general “ “ " 

processes, though there the influencer is not usually “ 

Lrp and Bass 1961). Other investigators who have discussed the elteci or 

the experimenter’s status on subjects’ susceptibility ” ““952^ and 

Glucksberg and Lince (1962), Goranson (1965), Krasner tivo 

Matarazzo, Saslow, and Pareis (1960). subject’s 

The effect of experimenter status can Thus, Birney 

response is not a direct measure of socia _t,*ained responses from 

(1958) found that his two faculty his^student ex- 
subjects refiecting a higher need achieve when in interaction 

perimenter. Subjects may feel a greater subjects may feel 

Lh others who have probably achieved ™ore; or at y ^ 

it would be more proper to respond 

such company. The effect of the expe illustrated by McTeer 

especlaUy if he is known to the subject, has also been illustrat y 

(1953). the effects of the experimenter’s 

In many of the studies bearing number of 

status, the samples of for the differences obtained, 

factors other than status could have . _ . etaius from student expen- 

Thus not only do faculty experimenters 1 studies where larger 

menters but they are likely to be older j^^mers were usuaUy 

samples of experimenters were emp ’ investigated, and this in itself 
aware that their status effects were somtwhat differently. Where 

might have made them perform the ®pP®" , ug^avior were used to define 

the subjects’ perceptions of 'h® actually occurred was not neces- 

Status it was noted that the behavior cubiects. What seems especially 

sarily the same as that reported y ^ experimenter is varied 

needed, then, is a study in which t e s ynriation. Just such a study 
without the experimenter’s knowle ge available for the analysis 

was carried out by John Laszlo, w ^ administered the photo- 

reported here. There were 3 . -ubjects were told they would 

rating task to 64 subjects. Half the (,y «just a stu- 

be contacted by a prestigious ff^m subjects when he was 

dent.” Each experimenter, then, ° n[,out his knowledge of 'hat fac . 

a higher status and a lower status person ^hom^^ 

Table 5-6 shows the tendency for e P " successful 

lower status to obtain ratings o of verbal reinforcement, t c 

persons. Although this was not priesen (1960), who a so 

results are reminiscent of those of to obtain more favorable 

found a tendency for a lower status exp for having employed 

reactions to photographs. More directly analog 



76 


The Nature of Eipcrimenter Effects 


TABLE 5-5 


Experimenter's Status and 

Success at 

Controlling 

Subjects' Verbal Behavior 



Variable 

Correlation 

P 

Businesslike 

+ 43 

.001 

Professional 

+ 33 

.01 

Loud 

- 31 

02 

Behaved consistently 

+ .26 

.05 


subjects’ perception of their expenmenter’s behavior dunng the cxpenment 
Higher status experimenters, as defined by their subjects’ perception of their 
behavior, were sigmficantly more influential in changing their subjects 
responses In this particular study we cannot be certain that subjects’ ratings 
of their experimenters actually reflected differences in that behavior Possi- 
bly those subjects more susceptible to the influence of the experimenter only 
perceived him differently than did less mfluenceable subjects It is also 
possible that having been influenced by an experimenter, subjects described 
that experimenter according to their conception of the sort of person by 
whom they would permit themselves to be influenced Even if these more 
influential experimenters did not, in fact, behave as their subjects stated, it 
IS instructive to note the pattern of characteristics ascnbed to more influen- 
tial experimenters At least the stereotype of the behavior of more influential 
experimenters includes their being seen as behaving in a way associated with 
higher status 

We gain some support for the idea that expenmenters who influence 
their subjects’ responses more behave in a more professional way from a 
study by Barber and Calverley (1964a) In their experiment m hypnosis the 
Single experimenter sometimes adopted a forceful, authoritative tone of 
voice and sometimes a lackadaisical one Subjects accepted more sugges- 
tions when offered in the authontative tone than when offered in a bored, 
disinterested tone These variables of interest, enthusiasm, and expressive- 
verbal conditioning study cited, and 
m ftat study, too, were related to the experimenter’s success at influencing 
verbal behavior Expenmenters who influenced their subjects more were 
T- ^ (f = + 43, p < 001), more enthusiastic 

(r + 4S, p < 05), and more expressive-voiced (r = -t- 24 p < 10) 
The general impression obtained from the studies relevant to the experi- 
menter s status is that when the subject’s task involves conforming to an 
experimenter s influence (as in studies of verbal conditioning or hypnosis), 
higher status experimenters are more successful in obtaining such con- 
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TABLE 5-7 


Experimenter's Status and Subiects' Ratings of Photos 
as Successful 


Variable 

Behaved consistently 
Professional 
Talkative 
Leg activity 
Trunk activity 


Correlation 

P 

- 35 

01 

-23 

10 

+ 26 

05 

+ 29 

05 

+ 24 

10 


bod, .bd 

.bddsdbU I. d»»'. 

higher status m their subjects eyes y obtained by Laszio 

these results are very much in hne with the trends f 


Experimenter’s Warmth 


lenmenters warmin 

j TinWr 119631 IS lUustraUve Two 

An experiment by Ware, Kowa, an democratic role and 

experimenters alternated playing a ,j,g military 

one that was cool, brusque, and autocrat of the various 

subjects of this study was one of s>g"‘> ocumng during the signal detec- 
conditions of environmental stimu bv the warmer-acting ex- 

tion task, those subjects who had een jj,ose contacted by 

penmenter detected signals sigmficantly better 

the cooler-acting experimenter (p < oroduction of verbal responses. 

When the dependent variable „^otive independent vanable 

the warmth of the experimenter was a _ expenmenter behavior in 

Reece and Whitman (1962) „„ j.mctly at the subject, smiling, 

terms of leaning toward the *“*’{“*’ ^avior^was defined in terms of the cx- 
and keeping the hands still Cold looking around the room, not 

penmenter leaning away from the i of course, able to judge 

smiling, and drumming his fingers J beharior, and this bc- 

correctly which was the warm an ' ,|„s was greater when the 

havior affected their verbal outpu j ,5 important not only be- 

cxperimenter was warmer This pa . ^5 well Although there are a 

cause of its content but because o 1 . o^penmenter, there arc few 

number of studies that manipula c ' otor behawor of the expenmenter 
that attempt to specify so carcfullj 

that IS to be part of the picture of wa™th^^^__^^ d,«mssed the 

In the area of projecuse testing 
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TABLE 5-6 


Experimenter's Status and the Means of Subjects' 
Photo Ratings 


STATUS 


Experimenter 

High 

Low 

Difference 

A 

-.58 

-.18 

+ .40 

B 

-1.70 

-.57 

+ 1 13 

C 

-69 

-.56 

+ .13 

Aieon 

-.99 

-.44 

+ .55 


the same task, are the two studies cited m the section dealing with experi- 
menter’s dominance One of these studies yielded results just like those ob- 
tained by Laszlo, but the other obtained results in the opposite direction In 
the Lasdo study, the results were not significant statistically, although all 
three experimenters showed the same tendency In this experiment, too, 
another finding that did not reach statistical sigmficance, but which is of 
interest, nevertheless, was that the effect of the expenmenter’s status was 
larger among subjects scoring higher on Rokeach’s (I960) scale of dog- 
matism These ate just those subjects who would be expected to be more 
Msceptible to the effects of the status of those with whom they interact 
This finding receives support from the work of Das (1960), who employed 
tout expenmenters to administer a test of body sway suggestlbibty The 
s a us 0 t e expenmenters varied from department chairman to attendant 
experimenters obtained more body sway from their subjects 
tp < UO), but It was the more suggestible subjects who showed the effects 
of ex^nmenter s prestige while the less suggestible subjects did not 
another^,‘^ Laszlo s study are supported by the results of 

r b phl-rating task This is 
toinntLirim ! contacted 57 subjects aL were filmed 

ludsments of the f h™* premstruction period predicted subjects’ 

ataas mad duno T '»= Photos HoJever, 

ed ^ r h other ratings were also 

ZTiav H ’ li'"* responses, but only those are listed here 

that may be used to define the status level of the expenmenter Those ex- 
penmenters who behaved more professtonally and consistently an^showed 
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jects on his behavior during the administration of the test The 21 scales 
employed were similar to those used in other studies described in this 
chapter Two of the scales were significantly related to the subjects’ per- 
formance Examiners rated by their subjects as more casual (p = 01) 
and as more talkative (p = 02) obtained supenor performance on the 
mtelhgence test admimstered By themselves these vanables do not seem 
convincingly related to warmth Table 5-8 shows the intercorrelations of 
five of the vanables on which examiners were rated as well as the correla- 


TABLE 5-8 


Examiner Warmth and Subjects' Intellectual Per- 
formance 


Cosuo/ 

Talkative 
Expressive face 
Encouraging 
Pleasant-voiced 


description of examiners 



Talk- Expressive 

Encour- 

Casual 

aftve Face 

aging 

-I 76 



+ 75 

+ 87 


+ .72 

+ 71 +67 


-1- 56 

+ 66 +45 

+ 86 


Subjects' 

Performance 

+ 83 
+ 81 
-1 61 
+ 52 
+ 44 


tions of each with subjects’ P«formance The »rreIaUons^e based the 
mean ratings ascribed to examiners and th P required 

tamed There being only eight examined, a com ^ 
for significance at the 10 level * 7 given a cluster rating 

cause of the high intercorrelations each exam ^ ^rrelation between these 

by adding the individual ratings together _ seems 

cluster scores and subjects’ ng wamth A word of cau- 

reasonable to regard this cluster as one J j „I,o performed more 

tion IS necessary, however It is possible that su^ccts « 

adequately felt differently about ““^''diflered, but because of the 
them differently, not because their beha performers at 

subjects’ own improved mood It |S .“e particular van- 

this particular task simply rate other peop g .,»n„ners did, in fact, 
ables^n the warmth cluster The ''.^s carrplcamnt. cn- 

behave as descnbed by their subjects, an far-fetched and 

couraging syndrome fostered better ^ cxpcnment 

IS consistent with the data from the Gor , j ,, problems of sub- 

In a subsequent chapter dealing more thoroughly P 
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effects of the examiner’s warmth on the subject’s productions In an expen- 
ment by Lord (1950), for example, three examiners administered the 
Rorschach under warm, cool, and neutral styles of interaction Subjects 
contacted by examiners in the warm condition gave “richer,” more imagina- 
tive Rorschachs than did subjects contacted under the cold condition Inter- 
estingly, the differences among the three female examiners in the responses 
they obtained were greater than the differences among the three expen- 
mental conditions Perhaps the ‘ natural” warmth or coldness of the ex- 
ammers was a more crucial vanable than the role-played warmth or 
coldness 


A good illustration of the magnitude of difference in subjects’ responses 
which may be associated with the expenmenter’s warmth or coldness comes 
from research by Luft (1953) He employed an undergraduate female 
expenmenter who administered 10 home-made ink blots to 60 freshman 
subjects half of them males, half females The task for each subject was 
simply to indicate those of the blots that were liked and those that were 
disbked Halt the time the expenmenter played a warm, fnendly role Halt 
the time she played a cool, untnendly role, which included asking the sub- 
jects some questions about current atfairs which they were sure to be unable 
Subjects contacted by the expenmenter in the warm 
mlnterfvL^®, “"'acted by the cold-role expen- 

57 nercent^H I V ~ ^ Among those subjects treated coldly, 

smcle snblrfri*'* """‘cd warmly, only a 

ot the sex of th ''‘*''^cd most ot the cards There was m effect 

treatment Luffs *1 ^ '"'^action with the expenmental 

wThkl vou 'cpeatrng “Lrke me and 

tiond evZce W ‘ them” (p 491 ) Addt- 

responses in storvtell'* c experimenter may obtain different 

and of Rodmck^and”lebanoff “'rhev T T'’' f 

ts Shrmo ^ ^"■""1' for their subjects^there 

the wtmrofftfe™™nl° g“ 'caTma^airbe® affected by 
Stanford Binet Scale to 40 eighth (1948) administered the 

treated more cooUy b^ 'he l x^^rf -- 

more warmly treated children, the cooUy trLLTlLr' 

Some data supportive of this result wp ' “'’"r sk IQ points 
Ekren, who kindly made the data available for f Wartenberg- 

penment 8 male examiners adm.m“%tarm 7 

(Block Design) to 32 male subjects Each cMm ^ ° ‘"‘c“‘Scnce 

j IS cacn examiner was rated by his sub 
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and from others (e.g., Sampson & French, 1960; Smith, 1961), it seems 
reasonable to conclude that when the subject’s performance is a measure of 
influenceabiUty, more influence is exerted by a warm, or warmly perceived, 
experimenter than by a cold, or coldly perceived, experimenter. The extent 
of the effect of experimenter warmth, however, appears to interact with su - 
ject variables and, very probably, with experimenter vanables and situa- 
tional variables as well. 


TABLE 5-9 


Experimenter Warmth and 
a Spool-Packing Task 


SUBJECTS Worm 

EXPECTATION Cold 

Mean 


Subject's Performance in 

experimenter 


behavior 


y/arm Cold 

Moon 

+ 1.32 -51 

+.405 

-1.32 +-51 

-.405 


0 0 


Some of the cited studies of experiment defined warmth in 

in terms of the experimenter’s behavior, and behavior. An experi- 

terms of the subject’s expectation of the simultaneously. Although 

ment by Crow (1964) employed both experimenters, the results 

only a small study, employing 13 subjects P details. Half the 

are instructive enough to 4rrant the telUng of some of the 


Experimenter Warmth and Subject s Performon 
a Letter-Canceling Task 


EXPERIMENTER'S 

behavior 




Worm 

SUBJECT'S 

EXPECTATION 

Warm 

Cold 

+ 1.53 
-1.25 


Mean 

+ .14 


Moan 

+ .60 
-.60 


-.14 
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jects’ ratings of their expenmenters, some evidence will be presented that 
suggests that subjects see their expenmenters somewhat as their experi- 
menters see themselves This fact increases our confidence that what sub- 
jects say their experimenters did is, in fact, related to what their 
expenmenters did do There is evidence for this, too, from the survey re- 
search hterature One example relevant both to this point and to the attn- 
bute of warmth is a study by Brown (1955) He reported on a national 
survey conducted by the National Opinion Research Center in which sub- 
jects were to rate the interviewer’s behavior dunng the data-coUection trans- 
action Better rapport in the interview was associated with fewer avoidable 
“don’t know ’ responses on the part of the subjects and with an increase in 
the number of usable responses given to open-ended questions How the 
interviewer “really” behaved we cannot know It is possible that more 
forthnght subjects evaluate their questioners more favorably It is also 
possible that after obtaining some forthright answers from subjects, data 
collectors in fact became more competent, or warmer, or happier, and that 
the subjects’ record of the interviewer’s behavior, although “accurate,” has 
actually been determined by the subject’s own behavior All these processes 
may be operating, and yet there can be a kernel of correlation between the 


interviewer’s actual behavior and his subjects’ perception of that behavior 
That, at least, is suggested by the data Brown obtained 

In some of the studies of the effects of the expenmenter’s warmth it 
was not the expenmenter’s behavior that was vaned independently or even 
assessed as it occurred naturally Rather, the set given the subject was 
yaned such a way that sometimes he expected the expenmenter to be a 
warm, likable person and sometimes a cold, unlikable person Though not 
ngina y employed to study expenmenter-subject interaction, this manipu- 

dna"' Of Back (1951) 

f ^ «npubbshed dissertation by Spires (1960) 

Soires ^ manipulaUon in a study of verbal conditiomng 

Srect “■'*>“"■"8 ‘o occur when subjects had been led to 

meot whlT a finding borne out by Sapolsky’s work 

ios ohL In Spires' stndy, 

ticidar n^r^onaht V associated with a par- 

o^ Subjects sconng higher 

MMPI, were little affected by theTuh"; “ad f ‘ 
menter’s warmth However, subiecte ^‘''“.fboot the expen 

Sion, as defined by the Hy scale of ihTZLr “ bystena” dimen- 
of the set they had beL given 

warmer said 'gTOd' to reinfoLsub^s- “P“™“‘crs believed to be 

the Hy scale iLeased then use of 

cent, whereas those scoring low on ftt T' 

word« nniv 1 « 6 me rty scale increased their use of these 

words only about 15 percent From the results of the studies cited so far 
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volving the type of task and the relative effects of the expenmenter’s be- 
havior compared to the effects of subjects’ expectations The lower 
marginals in Table 5-9, for example, show that for the spool-packing ex- 
penment there was no mam effect for the experimenter’s behavior The 
right-hand marginals, however, show that the difference between the mean 
performances of subjects expecting warm treatment was superior by -f- 81 
to that of subjects expecting cooler treatment Table 5-12 gives the anal- 
ogous values for each of the three tasks A plus sign preceding the standard 
score data indicates that performance was superior in the warmer condition 
For the spool-packing and letter-canceling tasks, the expenmenter’s actual 

TABLE 5-12 


Effects of Experimenter's Warmth Defined by Either 
Experimenter Behavior or Subject's Expectation 


Task 

Experimenter 

Behavior 

Sub/ect's 

Expectation 

Difference 

Spool’packtng 

0 

+ 81 

- 81 

Letter-canceling 

+ 28 

+1 20 

- 92 

Digit symbol 

+1 72 

+ 11 

+ 1 61 

Mean 

+ 67 

+ 71 

- 04 


behavior made virtually no difference compared to the subject s expectation, 
which had a more substantial effect on the subject’s performance The situa- 
tion was reversed for the digit symbol task There, the subject s expectation 
made no difference but the expenmenter’s behavior made a good deal of 
difference m the subject’s performance The last column of Table 5-12 
summanzes the interaction (/ = 25 9, <// = 1, p < 05) 


For simple tasks with httle meaning, subjects’ expectations may assume 
a greater importance, because subjects who view expenmenters more favor- 
ably may view his tasks more favorably, thereby transforming a compel- 
hngly mane proeedure into one that simply “must" have more value The 
experimenter’s behavior may lose relative importance just ecause o e 
pecuhanty of the task itself which absorbs the subject s attention In the 
quasi-intelhgence test, expeetations about 

come less salient because now the task is one like those the subject has been 
performing for years in school settings The experimenter ccomcs 
like those others in the student’s life who have administered '«ts-usually 
teachers— and is to be evaluated more in terms of his actual behavior n 
expectation of the expenmenter’s behavior becomes less important as soon 
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subjects had been found to have a conception of psychological expen- 
menters as relatively warm m manner The remaining subjects tended to 
expect experimenters to behave more coldly toward their subjects Half the 
time experimenters played the part of a warm experimenter after the man- 
ner of Reece and Whitman (1962) That is, they smiled more at their 
subjects, leaned toward them, and looked at them more Half the time 
experimenters played a cold role, defined by leaning away from their sub- 
jects, not smiling, avoiding eye contact, and drumming their fingers Three 
tasks were administered to the subjects One of these was a spool-packing 
task m which spools of thread were placed into an empty box, removed, 
repacked, removed, and so on for the duration of the task penod Another 
task called for the subjects to cross out all the W’s on a page of randomly 
arranged letters Both of these tasks have been employed or are similar to 
those employed by investigators interested m learning just how far subjects 
Will go m cooperating with a psychological experimenter (e g , Crowne & 
Marlowe, 1964, Orne, 1962) The third task administered to the subjects 
was a home-made version of a standard subtest of intelligence (digit sym- 
bol) which required the learning of a simple code for translating numbers 
into symbols Tables 5-9, 5-10, and 5-11 give the mean performance 


TABLE 5-1 1 


Experimenter Warmth and Subject's Performance in 
a Digit Symbol Task 


SUBJECTS Worn, 

expectation Cold 

Me on 


EXPERIMENTER 

BEHAVIOR 


Worfn 

Cold 

Meon 

+1 43 

-1 32 

+ 055 

+ 29 

-40 

- 055 

+.86 

-.86 



rntedscort have been converted to 

sV'dio ^ stud;™rLrXTt 

Tables 5-9, 5-10, and 5-11 suggests an interest, ng mteraefon effect m 
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More than an experimenter’s seore on a test of anxiety, his status and 
warmth are defined and determined in part by the nature of the experimental 
situation and the particular subject being contacted. The experimenter at- 
tributes” to be considered now are still more situationally determined. That 
is, the degree of warmth an experimenter shows one subject may be cor- 
related with the degree of warmth he shows other subjects. But whether he 
“accidentally” encounters a subject with whom he has had prior social 
contact seems less likely to be an enduring attribute and more purely situ- 
ational. The distinction is, nevertheless, arbitrary. Experimenters who are 
acquainted with a subject may differ in associated personality characteristics 
which make them more likely to be acquainted with other subjects as well. 
The effects of prior acquaintanceship thus may be due not simply to t e 
prior contact as such, but to correlated variables as well. 


Experimenter’s Acquaintanceship 


When the experimenter has had prior contact with his subject even 

when that contact is brief, the subject may respon * ctnHv hv 
experimental task. When the task was an intelligence test the s udy by 
SaL (1952) is the most interesting. Her subjects, 30 children all about 
three years old, were divided into three expenmental groups. Wi* tte 
children of group A she spent one hour each day 'rtur-TS 

school, participating as a good, interested "f a 

group b! she spent the same amount of time but her role was that of a 
Lll-app aring, uninterested teacher. With Ae children C. 

had no prior® contact. The results were defined m 
intelligence test scores from ‘/op'^Lts (p /.OS)®, while the 

IQ points (p < .01), group I 6 IQ points. This study illustrates 

no-contact control group gamed only 1. ^ P 
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as the subject finds the expenmental situation to have required no special 
expectation at all because of its resemblance to the school situation If that 
were the case, we might expect that expectations about the warmth of 
teachers would have been an effective determinant of subjects’ performance 
Those expecUng teachers to be warmer should have performed better at the 
task most similar to that usually administered by teachers Such data, un- 
fortunately, are not available, and the interpretation offered remains an un- 
supported speculation However, the fact that in an mtelhgence testhke 
task warmer-behaving experimenters obtained superior performance seems 
quite consistent with the data presented earlier 

In the discussion of the effects of experimenter warmth on responses 
to projective tests we encountered the work of Luft (1953) He had shown 
that subjects contacted by warmer expenmenters were more favorably in- 
chned toward ink blots If a warmer experimenter draws more “hlang” 
responses to blots we might expect that he would also draw more favorable 
responses to photos of people Some indirect evidence is available from the 
experiment in person perception which had been filmed Experimenters 
whose instruction-reading behavior was judged from both film and sound 
track to be more personal (r = -f 28, p < 05) and more interested (r = 
+ 23, p < 10) obtained ratings of photos as being of more successful 
people These are weak findings, however, because for the variables 
friendly ’ and “pleasant” the corresponding correlations were much lower 
than we would have expected (rs = -p 12, and + 09) if warm experi- 
menters dependably obtained more “success” ratings from their subjects 
When subjects rated their expenmenters on these same four variables in an 
expenment conducted by Suzanne Haley there was only the smallest trend 
or eyenmenters rated more positively by their subjects to obtain ratings of 
the photos as more successful 


Although we cannot always say exactly what the effect will be, the 
s aus an warmth of an experimenter often affect the responses given him 
y his subjects Here, and elsewhere (Edwards, 1954, Rosenthal, 1963 a), 
w en at point was made, the emphasis has been on research employing 
uman su jects There appear to be no experiments on the effects of more 
on performance of then ammal sub- 
us susoec,^ nevertheless, sufficiently compelhng anecdotes to make 

on the^nersfm-il ti, ^ performance of animals depends to some degree 

Pfnngst, 

tobe\“nrnTbrt\reVflect%nrex;;r”‘:'^ 

mL corem„r H n^penmenters tend to obtam 

more competent and more pleasant responses from their subjects 
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or drive level, the poorer the performance Pnor contact, it was suggested 
earher, reduces anxiety, and with a warm expenmenter more so than with 
a cold one In Berkowitz’s study, the results for the schizophrenic patients 
were somewhat different They, too, showed the slowest reaction time when 
their expenmenter had been warm m pnor contact However, there was no 
difference between reaction times of subjects with cold pnor contact and 
those with no pnor contact For schizophrenics, perhaps, cold prior con- 
tact does not reduce anxiety as it does for psychiatnc normals 

With college students as subjects, Kanfer and Karas (1959) investi- 
gated the effects of pnor contact on the conditiomng of first-person pro- 
nouns There were four groups of subjects, three had pnor contact with the 
expenmenter and the fourth did not Dunng their pnor contact one group 
of subjects was made to feel successful at a bnef intelligence test, another 
group was made to feel unsuccessful, and the third group was given no 
feedback All three groups who had expenenced pnor contact with the 
expenmenter conditioned faster than did the group with no pnor contact 
If it can be assumed that learning the contingency in a verbal conditiomng 
expenment is somewhat challenging intellectually, then the results of this 
study seem consistent with those of Sacks (1952), who found intellectually 
challenging tasks to be performed better after pnor contact with the expen- 


menter 

Kanfer and Karas, however, found no difference in performance among 
the three groups who had pnor contact with their expenmenter Such a 
difference might have been expected from the results of the studies descnbed 
here The lack of any difference might have been due to the fact that 
dunng the pnor contact subjects took a bnef IQ test, which might have 
made them aU sufficiently anxious to weaken the effects of the different 
types of feedback received about their performance The change to the 
simpler verbal conditioning task might have reduced the anxiety o a 
three groups to below the level of the control group, for whom the expen 
menter-subject interaction was new, strange, and therefore possi y more 
anxiety-arousing There is also the possibility that the pnor contact subjects 
retained their high anxiety levels through the verbal conditioning task and 
that more anxious subjects perfonn better at that task That is what we 
expect if the task is not challenging intellectually The two opposing in er- 
pretations must remain unreconciled for want of t e re evan ^ 
when anxiety is defined by a standard lest such as t e ay or ca e 
fest Anxiety or a near relative rather than by an experimental ^n^nTulahon 
It IS not well established whether more or 

or less verbal conditioning (Rosenthal, 1963d) Verba! ^°ndmoning may 
turn out to be less difficult than most items of an 
difficult than such performances as reaction time or > 

(Spence. 1964), and that may account for the equivocality of the data 

available 
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not only the effects of pnor contact but also the effects of the warmth of 
that contact When the experimenter had played a warmer role the gam 
m IQ was 9 5 IQ points greater than when she had played a cooler role 
(P = 02) 

There may be an interaction between the effects of prior contact and 
the particular experimenter in determining the effects on children s intellec- 
tual performance Marine (1929), for example, spent time with somewhat 
older schoolchildren and found this prior contact to have no effect on the 
children’s gain m IQ points Most clinicians feel that anxiety serves to lower 
intellectual performance under ordinary conditions Prior contact with the 
experimenter may serve to lower any anxiety about being contacted by a 
stranger and thereby lead to a relative increase in IQ When the experi- 
menter, in addibon, is warmer, anxiety may be still further reduced, thereby 
raising still more the level of intellectual performance This interpretation 
could be tested by having subjects high and low on test anxiety and high and 
low in fear of strangers receive prior contact or no pnor contact Those 
more anxious over tests and those more fearful of strangers should profit 
most from prior contact with the experimenter, and probably also from 
contact with a warmer experimenter 

The effects of prior contact also seem to depend on the task set for 
the subject When the task is a simple, repetitive motor task such as 
dropping marbles into holes, complete strangers seem to be more effective 
remforcers than experimenters known to the subjects — in one case, the pre- 
school subject’s own parents (Stevenson, Keen, & Knights, 1963) This 
IS just what we would expect on the basis of Hullian learmng theory 
When the response is a simple one, easily available to the subject, an 
increase in anxiety, such as we expect to occur in the presence of strangers, 
increases the performance level When the response is a difficult one, not 
easily available to the subject, as in an intelligence test, an increase in 
aMiety makes these less available responses still less likely to occur because 
the more available responses, more often wrong, become more likely due 
to the so called multiplicative effect of drive 

A recent experiment by Berkowitz (1964) is relevant He employed 
f schizophremc and 39 medically hospitalized normals in a study 

of the effects of prior warm contact, prior cold contact, and no prior 

tnl'tr TL" reinforced, but later 

re rei or« y the experimenter’s complimenting the subject for 
his performance Psychiatncally normal subjects who had prior contact, 
either warm or cold in character, were slower in reacting than were normal 
subjec s who had no pnor contact Of the two prior contact groups, those 
subjects who had experienced a warmer interacUon showed tL slower re- 
acuon time Berkowitz’s mterpretaUon of these results in terms of dnve 
level fits well with the interpretation of the results of the Stevenson et al 
study just mentioned Because the task is a simple one, the less the anxiety 
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TABLE 6-1 


Experimenter's Experience and Behavior Observed 
from Sound Track Only 

PREtNSTRUCTtONAL PERIOD 


Variable 

Correlation 

P 

Personal 

- 56 

.02 

Enthusiastic 

-41 

10 

Pleasant-voiced 

- 41 

10 

Speaks distinctly 

- SO 

05 

INSTRUCTIONAL PERIOD 


Variable 

Correlation 

P 

Personal 

- 43 

08 

Expressive-voiced 

- 44 

07 

Speaks distinctly 

- 64 

005 


boredom, however, .t that is what it was, was revealed through tone of 
voice and not through motor behavior It is of special interest to note that 
observers who had access to the sound track and aso to t c m cou 
not make the tone of voice judgments as well When the information 
IS in the sound track rather than m the film, viewing the film while list ning 
to the sound probably results in a decreased signal-to-noisc ""o 
&Thibaut, 1958) The film then only distracts the judges 
there was even a trend for some of the correlations based on he 
of the film to be opposite in direction from those based on judgments of the 

'““"Although the differences in vocal behavior between more and less 

experienced expenmenters did not affect the subjects 'J, 

present study, .1 is not ditricuh to imagine ^ 

behavioral Lercnces among expenmenters could ^ 

performance Studies in verbal conditioning are 

Here the tone of the expenmen.er as he utters his “8°^ » 

may make a substantial difference, and one do wh«Lr 

exjirienccd rcinforcers obtain better conditioning and. if they do, whether 

It IS bcc,ause their tone of voice IS different -.rvnrnce in iliai 

Even when the experimenter has had no 
role, his expenence changes dunng the course of his first expenment 
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There are some conclusions, though that can be drawn about the 
effects on the subject’s performance of pnor contact with the experimenter 
Often, at least, such contact makes a difference (Krasner, 1962, Wallin, 
1949) When the performance required is difficult, pnor contact, especially 
when of a “warm” quahty, seems to improve performance When the task 
is simple, pnor contact may worsen performance, although, it seems safe to 
assume, subjects may feel more relaxed about it When the task is of 
medium difficulty, no clear prediction is possible except that how the sub- 
ject IS occupied during the prior contact may make the major difference 


Experimenter’s Experience 

It seems reasonable to suppose that a more experienced experimenter, 
one who has conducted more experiments or at last repeated a certain 
experiment more often, may behave differently in the expenment than a 
less expenenced experimenter This difference in behavior alters the stimuli 
offered the subject so that we might expect him to behave differently 
We have already seen at least one expenment in which the expenence of the 
experimenter seemed to affect the speed of learning of his subjects, and 
these subjects were rabbits (Brogden, 1962) The less expenenced expen- 
menter obtained a slower rate of learning than did more expenenced 
expenmenters When the subject’s task was to construct stones to TAT 
stimuh, there was a tendency for examiners who had administered fewer 
TAT’s to elicit more storytelling material (Turner & Coleman, 1962) In 
the expenment m person perception, which was recorded on sound film, 
some of the 19 experimenters had pnor experience They had served 
in one of two other studies in which their task was also to present the photos 
of faces to their subjects and record subjects’ ratings of success or failure 
In this study, there was no effect on subjects’ ratings of the stimuh associated 
mih experimenters’ having had prior expenence m the experimenter role 
However, from the analysis of the films and of the sound track, it was 
evident that the more expenenced expenmenters behaved differently dunng 
the course of the brief preinstructional period and during the reading of the 
instructions Interestingly, it was in the sound track ratLr than in the film 

mlw track that the differences emerged 

Table 6-1 shows the larger correlations between experimenters’ behavior 
and their prior experience During both the preinstructional period and the 
instruction reading itself, the more expenenced expenmenters spoke in a 
less personal tone of voice and less distinctly They read the instructions 
with less expression and gathered the initial background information from 
the subjects in a less pleasant and less enthusiastic tone of voice It may be 
that the nature of the task was such that having been through it all 
before, the more expenenced experimenters were simply bored The 
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TABLE 6—3 


Serial Order of Subject Contacted and Experimen- 
ter's Behavior- Film and Sound Track 


Variable 

Interested 

Active 

Enthusiastic 

Encouraging 

Relaxed 

Leaning toward S 
Head nodding 
Accuracy 
Time 


Correlation 

P 

-31 

02 

- 24 

10 

- 23 

10 

- 23 

10 

+ 26 

06 

- 26 

06 

- 25 

07 

+ 25 

07 

- 31 

03 


senal order of subject contacted, and 7' soun^ 

substantially Table 6-3 shows, however, that the 77 , Iwh were 

track made possible the observation of different l^temer^ 

determined in part by the serial order of subjects contacted Expenmenteis 
seem™ ,0 becoL leL interested and less -"voWf m . eir mterae i n ^ 
later-contacted subjects but more relaxed as well ‘ .7 ‘^ts 

tions more rapidly and more accurately to '7" 7' "'Si 

which suggests an expected practice effect 

stabstically, experimenters who to be 

m"ore": faster [r= - 18] m reading their in- 

rc™fn^L7xp+nment,.m^^^^^^^^^^ 

ZVbo7d“”tLugrmore7r°fi''<="‘ “J/^^tmed lo affect to’ s^ 
behavior changes 7°™ ^ 7den^t'aTk"LMer-contacted subjects tended 
jects’ responses to unsuccessful people than did earlier 

to rate the photos as being o more PJ 

subjects (r = — 31, p< OZJ comfort and competence 

expenment the data collector acq i E^^Ung task employed, it was 
and thereby greater status ^r t ph 5 ,n,us d,d ,cnd to 

shown earlier that expcnmcnters judg , • n^oolc 

obtain ratings of photos as to c^dudc that the amount 

From the evidence available responses collected from 

of expenence of an «P77"'" ,^hcn expcnencc is defined either 
his subjects This seems to be the case v n 
o\cr sc\cral expenments or within a si g 
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At the end of his first experiment he is mote experienced than at the 
beginning Sarason (1965) reports a finding from an unpublished study 
by Barnard (1963) which illustrates that even dunng the course of a 
single experiment, the behavior of the expenmenter can change system- 
atically In the Barnard study experimenters administered a phrase as- 
sociation task to their subjects The degree of associative disturbance shown 
by the subjects seemed to be related, at least sometimes, to the pnor 
expenence of the experimenter dunng this study Barnard’s expenmenters 
also reported a drop in anxiety over the course of the expenment which 
might have accounted for the effects of experimenters’ expenence on sub- 
jects’ degree of disturbance 

In the experiment recorded on film, the serial order in which each sub- 
ject was seen was correlated with the expenmenter’s behavior It was 
thereby possible to learn whether later-contacted subjects were meeting an 
expenmenter whose behavior had changed from that shown earlier subjects 
Considering only the premstructional penod, none of the ratings of the 
expenmenters’ behavior correlated “significantly” (p < 05) with the serial 
order of the subject contacted Behavior dunng the instruction penod, 
however, did seem to be affected by the number of subjects the expenmenter 
had seen previously Table 6-2 shows the larger correlations obtained when 


TABLE 6-2 


Serial Order of Subject Contacted and Experimen- 
ter's Behavior Silent Film 


Voriafa/e 

Corre/otion 

P 

Active 

- 32 

.02 

Body activity 

- 32 

02 

Trunk activity 

- 32 

02 

Leg activity 

- 30 

03 

Expressive face 

-24 

.08 


observation ot films without sound track 
Table 6-3 shows the correlations obtained when the sound track was added 
to the films for a different group ot observers The general decrease of 
motor activity dunng the instruction penod as snccessive subjects were 
contacted seems consistent with Barnard’s report of decreased experimenter 
anxiety oyer the course of an experiment Again, the addition of another 
channel of information resulted in a decrease of “correlational information" 
about these vanables When the sound track was added only one of the 
vanables shown ,n Table 6-2 remained significantly correlated with the 
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dude greater susceptibility to social influence than is the role of data 
collector, whether the collector be “experimenter,” “examiner,” “therapist,” 
or “interviewer.” When the task employed by the experimenters was the 
administration of an intelligence test, Masling (1959) found results analo- 
gous to those obtained by Heller, Myers, and Kline. Also employing actor- 
subjects, Masling found warmer subjects treated in more friendly fashion 
by the examiners. 

For a situation in which the experimenter was trying to follow a more 
highly programmed procedure with his subjects, Matarar^ provides an 
illuminating anecdote (personal communication, 

are reported elsewhere (Matarazxo, Wiens, & Saslow, 1965), but bnefly, 
the study was of the effect of the duration of an interviewer’s utterance on 
the duration of the subject’s utterance. The interviews were divided into 
three periods. During the first and third periods the 
average utterances of five seconds. During the middle period he tried to a 
erage ten-second utterances. Regardless of the patterns employed (e.g 
5, fo, 5; 10, 5, 10; 5, 15, 5) the subject’s average length of utterance was a 
function of the length of the interviewer’s utterance. Matara^ya^ed the 
possibility of a feedback effect upon the interviewer ^ ^ 

Object’s ingth of utterance. Unless he S 

length of Utterance, it seemed that his own length of 
affected by the subject’s length of utterance. Thus in one 
interviewer overshot his target length of five secon , ^ subject 

in the first of the three periods; then, in the third 

had increased the length of his utterances^ ^ ’^^.orrThis‘^efl:c; dis- 
interviewer overshot his target by 22 per KP , • mind, 

appeared completely when h?s,„esis^occurred again. This 

Subsequently, when ^ ^ kn^h of five seconds perfectly in 

time the interviewer achieved the targ g however, after the 

the first period of the interview. In P period, he over- 

increasing length of his subject s utteran 

shot his target time by 10 P"”"' the course of his experiment 

What happens to an ^ i ^^Pt-h a way as to affect sub- 
may alter his behavior toward his 1 by standard stimulus 

jects’ (1) judgments of the degree personality,^and (3) test-retest 

persons, (2) n of^this book! Chapter 12, dealing 

reliabilities of personality tests. In P details Briefly, for now, 

with the effects of early data returns, w.l give the det is.^Bri ^ 

26 experimenters administered P fed to expect that their 

female subjects. Half the experim .uccessful and half were led 

subjects would see the stimulus unsuccessful. Accom- 

to expect 'heir subjects to see th P_^^^ people and 

phces were trained to rate the pno ^ initial expectancy, 

sometimes as of unsuccessful pcop c. g 
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Experimenter Experiences 

Not only the amount of expenence the expenmenter has accumulated 
but also the experiences he has encountered in his role as data collector 
may affect his subjects’ responses Earher, in discussing the effects of 
expenmenter’s warmth, it was suggested that the subject’s response may 
affect the experimenter’s behavior in his transaction with the subject But, 
since the expenmenter’s behavior may influence the subject’s response, it 
IS easy to view the expenmenter-subject system as one of complex feed- 
backs The response given by the subject may itself affect his next response 
at the same time it affects his expenmenter’s response, which will also 
affect the subject’s next response Focusing on the expenmenter, the same 
analysis is possible His behavior affects his own subsequent behavior but 
also affects the subject’s response, which, in turn, affects the expenmenter’s 
next response The resulting complex of intertwining feedback loops may 
be incredibly complex but no more complex than that characterizing other 
dyadic interactions (Jones & Thibaut, 1958) 

In this section the discussion will deal with such ongoing effects on 
the expenmenter that have repercussions on the responses he obtains from 
his subjects The subject’s own effect on the experimenter will be con- 
sidered as well as such other influences as the physical charactenstics of the 
laboratory in which the expenmenter works and the nature of his inter- 
action with any pnncipal investigator to whom he may be responsible 


Subjects’ behavior. An expenment by Heller, Myers, and Khne 
(1963) demonstrates the effects of a subject’s behavior on the interviewer’s 
behavior Each of 34 counselor-interviewers contacted 4 subject-clients 
m a clinical context Actually, each counselor interviewed the same four 
chents,” who were accomplices of the investigators and trained to play 
one of four roles Two clients played a dominant role, and one of these was 
nen y about it, the other hostile The other two clients played a dependent 
role, one fnendly, the other hostile Observations of interviewer behavior 
revealed that contact with a dominant client led to interviewers’ behaving 
in a more dependent manner (mean dominance score =12 1), while 
contact with a more dependent client led to more dominant behavior 

rltTTth ’ When interviewers contacted more hostile 

chents they responded ,n a less fnendly fashion (mean =114) than when 

we?e m^th ^ = 21 4. p < 0005) These results 

Thle rr investigators had predicted In this study it is reason- 

^ thl .nh , 2' a* experimenters and the interviewers 

wac mnrp interviewers’ perceptions of their own role 

havp H * H /k collector than of expenmental subject This may 

have reduced the obtained effects, since the role of subject is thought to m- 
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with the result being like that of adding a constant to an array o£ scores 
Such a constant does not, of course, affect the correlation coefficient 

As mentioned, in experiments employing accomphces whose task it is 
to influence the interviewer, or the examiner, or the experimenter, it is 
sometimes useful to regard the accomphce as the expenmenter and the 
data collector or chnician as the subject In the experiment under discussion, 
the accomplices may be regarded as experimenters of a kind, since they 
were makmg the programmed responses So, too, were the experimenters, 
but their behavior in carrying out the directions of the experiment could 
vary, within limits, without their being regarded as incompetent experiment- 
ers who were “spoiling” the experiment There is no direct measure of the 
experimenters’ behavior in this expenment, as it was not filmed, but there 
IS good evidence that their behavior affected the performance of the 
accomphces It will be remembered that half the time accomphces were 
to give -t-5 and half the Ume -5 responses to the photos presented by 
their expenmenters Sometimes these responses confirmed the experi- 
menter’s expectancy, someumes they disconfirmed it Accomphces id not, 
of course, know that they were confirming or disconfirming by their re- 
sponses, or that the expenmenters had any expectancy at aU All accom- 
phces came close to giving their target ratings of +5 "5 when 

considenng that the photos’ standardized value was approximately zero 
The mean rating given (disregarding signs which, of course, were not jhsre- 
gardedby the accomplices) by accomphces in the four f 

was 3 99 ! or about one scale unit too close to the neutral of the sca^e of 
success or failure (<r= 27) Table 6-4 shows the mean absolute ratings 

TABLE 6—4 

Distance from Target Values of Ratings Made by 
Accomplices 

Hxperimenfer's Expectancy 


Confirmation 

Disconfirmation 


given by accomphces to the ^erto sUndmd“scorerTf™the 

thTeVrimenters 

cells, all standard scores would have expecting and receiving 

complices assigned at random to the p 
ratings of the photos as failures gave rating 
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half the experimenters had their expectancies confirmed and half had to 
expectancies disconfirmed by their first two subjects who were the accom- 
phces That is, half of the expenmenters who were expecting ratings of suc- 
cess (-1-5) obtained ratings of success, while the other half obtained 
ratings of failure (-5) Half the expenmenters expecting ratings ot 
failure (—5) obtained such ratings, and the other half obtained ratings o 
success (-1-5) from their “subjects ” Subsequently, when the expenmenters 
contacted teal subjects, the mean rating of the photos obtained by expen- 
menters whose expectations had been confirmed was —1 55, that obtained 
by experimenters whose expectations had been disconfirmed was 0 
(p= 05) It may be that the confirmation of expectancies gave added 
confidence to these expenmenters, a confidence reflected m a more pro- 
fessional, assured manner Earlier, data were presented that suggested that 
such a more professional, prestigious expenmenter was likely to obtain 


ratings of the photos as being of more unsuccessful people 

Before and after the experiment, subjects were tested with the Taylor 
Manifest Anxiety Scale and the Marlowe-Crowne Social Desirability Scale 
Whether their expenmenter had his initial expectations confirmed or dis- 
confirmed did not affect subjects’ level of anxiety However, subjects whose 


expenmenters had their expectanaes confirmed showed a significant increase 
in their social desirability scores compared to the subjects whose expenment- 
er’s expectancies had been disconfirmed (p < 05) It can again be 
hypothesized that confirmatory responses increased the expenmenter’s 
self-confidence, leading to his behaving in a more professional manner In 
the section dealing with the effects of experimenter status, we saw that 


increases in status and authority on the part of the experimenter lead to a 
greater degree of propnety in the responses he obtains from subjects That 
seems to be what happened in this expenment as well 

Changes in test scores is a different matter from changes in test 
reliability All subjects may earn higher or lower scores on a retest 
without the retest reliability being affected The retest reliability of the 
subjects’ scores on the social desirability scale was not affected significantly 
by the confirmation or the disconfirmation of their expenmenter’s expecta- 
tion, though there was a slight decrease when the experimenter’s hypothesis 
had been disconfirmed (r = 74 vs r = 66) When their expenmenter’s 
expectation had been disconfirmed, the reliability of subjects’ anxiety scores 
was ower (r -1* 80) than when their experimenter’s expectation had been 
confirmed (r = + 90, p of difference = 06) It is interesting to speculate 
on the possibility that the behavior of a more self confident expenmenter is 
such as to increase the retest reliability of his subjects’ test scores It may be 
mat the general retest-taking set provided by such an expenmenter is one 
for consistency of performance This set could operate in spite of a general 
tendency for the expenmenter’s manner to affect subjects’ retests uniformly, 
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m which an expenmental transaction occurs We know httle enough about 
how the scene affects the subject’s response, we know still less about how 
the particular laboratory setting affects the expenmenter Riecken wondered 
about the effect on his subjects of the expenmenter s white “=>1 Per- 
haps that makes him more of a scientist m his subjects eyes P p t 
does and perhaps, too, it makes him more of a scientist in his own eyes If 
Mothes cL mL’e the man,” then perhaps, too, a laboratory can make 
scientist feel more the part What impresses and nSents ^ 
impress and affect the experimenter Perhaps the most ^ ^h 

ratory directors is not susceptible to sue e ec s himself 

ever, we must ask what percentage of his laboratory s himself 

collects It IS P^baps more ^^s,a^tus of the settmg in which 

systematic effects possible if indeed the phy 

"laboratory’s” characteristics Mintz ( ) m a "beauU- 

photos of faces were judged more energe ic 

fled" room, more f«f g« ® qI) Observations of the two 

less pleased in an ughfied room (p < , ,1,, suggested that 

expenmenters who administered the p o I S conducted the ex- 
they, too, were affected by the rooms 1 photos affected by their 

penments Not only were their own ^=>“"87 P„n^nd thL be- 
locale, but so too was their attitude toward the expenment 

havior toward their subjects ,1, Cnrannc Haley show the effects of 

Some data collected their effects on 

laboratory room characteristics 1 subjects to rate photos 

expenmenters’ behavior The expe . %ere were 14 expenmenters, 
of faces for degree of success and subjects were 

86 subjects, and 8 ‘“boratory roo p expenmenters 

assigned to rooms at random following four di- 

(not including the one who us appearance, (2) how 

mensions (1) how profession ^ ™rtpnsnc user judging from the 
high the status was of the ^ “ ^^roomnas, (4) howdisordcrly 

physical appearance, (3) how com o significantly related 

rtie room sL None of the room 'baraemnstms^wer^^^ g^^ charaetensties 
to the subjects’ ratings of the photos o proportion of the 26 

of the rooms were significantly rc ^ behavior Tabic 6-5 show's the 

ratings subjects made of their expenrn ^ hfhavior as judged by their subjects 
correlations between the expenmen •‘disordered " The room 

and the room charaetensties of omitted since its corrclaUon with 

characteristic of “status of the user 
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of the scale In this they were significantly different from the accomplices 
in the other three conditions (p < 02) It must be emphasized that only 
the experimenters were given an expectancy and only the expenmente 
expenenced confirmation or disconfirmation In some way, me cxperi 
menter’s behavior was such as to drive the accomplices’ ratings off the target 
and into the direction of the neutral point if the expenmenter expected and 
obtained negative ratings from the accomplice-subjects Because there was 
no direct observation of the experimenter-accomplice interaction, the in- 
terpretation IS speculative It may be that expenmenters expecting subjects 
to see failure in others feel sorry for such subjects Under a hypothesis of pro- 
jection, these subjects would be viewed as feeling themselves to be failures 
When the expenmenters expecting failure perceptions from their subjects 
have these expectancies disconfirmed, they need no longer feel sorry 
for their subjects However, when they learn from the accomplices in 
the confirming condition that they do indeed see others as unsuccessful, 
they may react with special warmth and friendliness to these subjects 
suspected of feeling inadequate This warmth, which has been shown to 
increase the perception of success of others, may similarly influence the 
accompbces in spite of the fact that they have learned a part to play 
and, most likely, are quite unaware of being so influenced by the experi- 
menters they believe to be their “marks” or “targets ” But if this interpre- 
tation were sound, what about those accomplices who also rate photos 
as unsuccessful for those experimenters expecting ratings of success*^ Would 
we not expect the experimenters to be warmer, too, to these failure per- 
ceivers'^ We would, ordinarily, but the effects of disconfirmation may be to 
disconcert the experimenter so that he cannot be an effective “therapist” for 
his unwilling and unneedful “client ’ 

From the evidence presented in this section, it seems clear that the 
subject s behavior can affect the experimenter’s behavior which, in turn, 
may have further effects on the subjects behavior Each participant in the 
interaction affects not only the other but himself as well The effect on the 
participant by the participant himself may be direct or indirect It is 
direct when he recognizes the response he has made, and this recognition 
affects the probability of a subsequent response It is indirect when his 
response alters the behavior of the other participant in such a way that 
the new response affects his own subsequent response It makes no differ- 
ence whether we speak from the viewpoint of the subject or of the experi- 
menter It makes no difference whether the expenmenter is interacting with 
^ a accomplice Experimenters do not simply affect 

subjects Accomplices do not simply affect their targets Subjects and 
targets both “act back ” ® ‘ 

Characteristics of the laboratory. Riccken (1962) has pointed out 
how much there is we do not know about the effects of the physical scene 
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function of the scene, subjects might respond differently for him in some 
experimental tasks, though in the present task of judging the success 

of others they did not. , . , . ■ 

There is one thin line of evidence that the behavior of the expenraenter 
was, in fact, affected by the characteristics of the rooms to which they ha 
been randomly assigned. All experimenters were asked to state the plumose 
of the experiment at its conclusion, in order that their degree of ; 

ness about the intent of the study might be assessed. In addition, to 
written statements were assessed for the degree of senousne s wto 
these graduate students appeared to take the 

experimenters who had been assigned to a more ^^ordered room were 
suspicious of the true intent of the experiment. The bon “b ined 

was - 42 but with the small number of expenmenters (14) this was not 
statisticali; significant. How seriously the experiment ShTrJom 

did appear^elated to the rooms to which they had 

was more disordered, experimenters were more fr — + 39) In 

.aJiUo..lIlte.oo»w«moret«mI ' ..p.. 

written statements (r=— .45). ,„„_^i,~racteristics of corn- 

unlikely to have occurred by chance, since 0 ^ The two 

room charactenstics together predict 

statements with a multiple R if behavior it seems more 

experimenter’s room predicted his su s q behavior during the ex- 
reasonable to think that it might have ® disordered, less 

periment as well. It is not too clear 1 experiment 

comfortable room should make ‘ ® .jvho were not in psy- 

more seriously. Perhaps these gra . ^^5 carried on best in the 

chology, felt that a scientifically seno 

cluttered and severely furnished I ^ colleges at which they were 

encountered in the psychology depa stereotype of the scientist’s 

undergraduates, and which seems to fit the yv 

ascetic pursuit of truth. . uj^b the subject interacts 

It seems, then, that the physica response in two ways. First, 

with his experimenter may affect t e ® 1 by making him feel 

the scene may affect directly the su j ^j^pgrimenter’s behavior, which 
differently. Second, the scene may affeci P msk. Research on 

in turn affects the subjects’ , Hemnninant of the subject’s and 

the physical scene as an what data there are suggest 

experimenter’s behavior is in its in y 
the wisdom of collecting more. 

. r With more and more research carried out 
The principal ^fincreasing that any given experimenter 

in teams and groups, the chance -ilone. More and more, there is a 

will be collecting data not for imse 
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TABLE 6-5 


Experimenter Behavior and Characteristics of his 
laboratory 


Varioti/e 

Talkative 

Loud 

Pleasant-voiced 
Expressive-voiced 
Hand gestures 
Arm gestures 
Trunk activity 
Leg activity 
Body activity 
Expressive face 
Encouraging 
Friendly 
Relaxed 
Interested 


PROFESSIONAL 

Correlation 

P 

+.24 

.03 

+.25 

.02 

+.04 

_ 

+ 22 

.05 

+.32 

.005 

+.21 

.05 

+.17 

_ 

+ 31 

007 

+.22 

05 

+.32 

.005 

+ 12 

_ 

+ 19 

.10 

+ 20 

.07 

+.16 

_ 


DISORDERED 


Correlation 

P 

+.08 

_ 

+.09 

- 

+ 19 

.10 

+.09 

- 

+.23 

.05 

+.11 

- 

+.26 

.02 

+.15 

- 

+.21 

.05 

+.05 

- 

+.25 

.02 

+.07 

- 

+.10 

_ 

+.20 

.07 


professional” was 98 The room characteristic “comfortable" is not listed 
^1 judgments of experimenter behavior reached 

onmf correlation showed the experimenters in more 

comfortable rooms to have a less pleasant voice (r = _ 24 p = 03 ) Be- 
cause it occurred as the only significant relationship in a set of 26 correla- 
tions, It IS best mentioned and put aside 

nenmema? room is a more professional-appearing locale for the ex- 
havinr n flT behave, or at least are seen as be- 

also to' be com verbally active manner They are seen 

Cerent '"“'“y The pattern ts not very 

mf^be d^e to the Jh disordered, and that 

ness and disorderedness'of th“ab The" professional- 

charactenst.es of the rooL auLld ‘th"" J 

expenmenters (as M.ntz's subiects f 

ferenUy in different rooms) or whetter ‘’f 

affected bv thpir ^ Wncther experimenters were sufficiently 

‘rr 'f “■ 

r “ .K. ' "S; ,ct 

sub,e«s- resLns rrlr °f *= Physical scene on 

subjects responses If the experimenter appears differently to subjects as a 
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already shown, “proper” responses are more often given to data collectors 
of higher status in both laboratory and field research 

In the experiment described, subjects had been tested for anxiety and 
social desirability before and after the expenment There were no effects on 
subjects’ social desirability scores associated with which of the two pnncipa 
mvesugators had contacted their experimenter early in the experimen 
However, subjects whose expenmenters had been either praise 
by one of the pnncipal investigators showed a significantly 
in anxiety over the course of the experiment than did subjects whose 
experimenters had earlier been contacted by the other pnncipal investigator 

^Ttee’is alditional evidence of the effect of pnncip« 
on the data obtained by h.s research assistants In 
were 13 principal investigators, each of whom 

two research assistants (Rosenthal, Persinger, .i^seajch grants,” 

1963) Before the pnncipal investigators received th themselves 

which allowed them to hire their research f ^ 

served as expenmenters in correlated significantly 

Remarkably enough, the P"“‘P*' ^ ,j,e,r different sample of 

the photo ratings their as.stants such a 

subjects (rho = + 40, p < OT) , .t., pnncipal investigators 

correlation could be enhanced by the po in personahty A 

employ research assistants who at® s™ j mvestigator and his as- 

correlation between an attnbute of the p P , 1 ^ t[,n effect of the 

sistant’s obtained data could then be no ”6 been well 

assistant’s personality on the subje P described, how- 

established by now and is not so in ngui g principal investigator The 
ever, assistant were assigned at random to heir 

correlation between the principal inves ig nature of the 

his assistants was only 02 There ote, ‘ altered their behavior 

pnncipal investigator’s interaction wi rpsnonses The principal in- 

m » W.V as to affect their subjects responses 


gator s neeu lor social -- ■ 

sistants, although that correlation ( ^ approval and his own 

that between the principal o-s pictured in photos (—49) 

subjects’ perception of the success ® P ‘.guccess” ratings obtained by 
Finally, the correlation between t e ‘o , . research assistants 

any pnncipal investigator and those o 
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pnncipal investigator to whom the expenmenter is responsible for the data 
he collects The more enduring personal characteristics of the principal in- 
vestigator as well as the content and style of his interaction with the 
experimenter can affect the responses the subjects give the experimenter 
In telling of the effects of the subjects’ responses on the expenmenter’s 
behavior, an experiment was mentioned in which the expectation of the 
expenmenter was confirmed half the time and disconfirmed half the time 
In that same expenment, two other vanables were studied, both relating 
to the effects of the principal investigator on the data obtained by the 
expenmenters One of these vanables was the affective tone of the re- 
lationship between expenmenter and pnncipal investigator, the other was 
the individual differences between pnncipal investigators After the experi- 


menters contacted their first few subjects (who were actually accomplices) 
they were given feedback by one of two pnncipal investigators on how 
well they had done their work as expenmenters Half the expenmenters 
were praised for their performance, half were reproved Each of two 
pnncipal investigators contacted half of the 26 expenmenters and ad- 
mimstered praise and reproof equally often When the expenmenters had 
been praised before contacting their real subjects, those subjects rated 
photos as being of more unsuccessful people (mean = —160) than 
when expenmenters had been reproved (mean = — 74, p < 05) When 
expenmenters had been either praised or reproved by one of the pnncipal 
mvestigators, their subjects subsequently rated people as less successful 
(mean — —157) than when expenmenters had been either praised or 
1 pnncipal investigator (mean = — 78, p< 05) 

rioth the kind of person the principal investigator is, as well as the content of 
IS interaction with the expenmenter, affect the responses subjects give 
®^penmenter Praising an expenmenter (and contact with a certain 
foLlrH investigator) may have the same effect on his behavior 

tiip. f confirming his expectation does He feels, and 

nf r/w-n ; professional, self confident manner, a pattern 

successful V stings by subjects of others as less 

reaction on th m order that we do not know the reasons for this 

status exDenmpn^p'^ subjects to a more professional, confident, higher 

academic setting, a higher stSisS'*' T‘‘” 'V “ 

fpptiniT wii.ni, A 1 j ®^P®”uienter may evoke more negative 

nettfvr tlctn I" 

S mm si r h\" ■nst.tutionahzed In the 

ofthesnbject (Rtechen, 1962). he 2/^ ^eted ItTa 

T snbjects -know or'mtn.t someig j S 

thev d° d ' !!““ snccefs m photos 

they will be regarded as immodest by the higher status experiment^ As 
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— 57) than did expenmenters who had not been made self-conscious 
(mean = -f 37, p < 06), A subsample of the interactions had been 
filmed so that there were clues available as to how the more self-conscious 
experimenters might have behaved differently toward their subjects so as 
to obtain judgments of others as being more unsuccessful The observations 
again come from three groups of observers One group had access to th 
L and sound track, one group saw the film but did not hear the sound 
track, and one group heard only the sound track None of observation 
made by this last grLp of observers was related to the experimentally cre- 
ated self-consciousness of the experimenters „„,„„nlvtl,p 

Dunng the brief premstructional transaction, observers who saw only the 

“Va* .t'E— a- — “I"'- 


table 6—7 


Instruction-Reading Behavior as a Function of Pro- 
cedure Consciousness Induced by Principal Invest,- 


gators 


Variable 

Likable 

Courteous 

Interested 

Slow-speakmg 

Honest 


OBSERVATION CHANNELS 


Sound F i/ms 


r 

P 

-45 

06 

-43 

07 

- 07 

— 

-43 

07 

-42 

08 


Silent Films 
r P 

-41 10 

- 15 — 

_ 40 10 

_ 58 01 


ihc films with or without 
menters was judged less likable from ® ^ ^vhcn their tone of 

the sound track They were judged less 

voice could be heard, less intcrcstc y observation of the sound 

heard Judged to be more slow ,„ck alone Al- 

film, that was not the case from “ ® i! fferent sense modalitj does not 
though the addition of information when vve would not 

always add usable informntion. ,t sometimes does 



104 


The Natnre of Experimeoter Effects 


from a different sample of subjects was + 38, which, for the sample of 13 
principal investigators, was not significant Omitting the three female 
pnncipal investigators raised this correlation to + 75, p < 02, suggesting 
a possible interaction effect Table 6-6 shows that such an interaction did 
occur The mean photo ratings of success, in standard score form, obtained 

TABLE 6-6 


Experimenters' Data as a Function of Data Obtained 
by Their Maie and Female Principai Investigators 


PHOTO RATINGS OBTAINED 
BY PRINCIPAL 
INVESTIGATORS 




Success 

Failure 

Dilference 

t 

P 

SEX OF 

PRINCIPAL 

INVESTIGATOR 

Male 

Female 

+ 63 
-1 31 

- 54 
+1 22 

+1 17 
-2 53 

2 09 

2 38 

.07 

05 


Difference 

+1.94 

-1.76 

3 70 




t 

2 07 

2 35 


3.12 



P 

08 

05 



.02 


by the experimenters are shown separately for those whose pnncipal investi- 
fro”*,u themselves obtained mean ratings of either success or failure 
assislanu^nhf'” When the principal investigator was a male, his 

When tlip r. tatings significantly similar to those he had obtained 

sitmifinnilif investigator was female, the assistants obtained data 

pnncinal inve^f °*i ° obtained The sample of female 

LSes a suh'rt dtttti are clear The 

earlier on the L axpenmenter depend not only, as we saw much 

pn^airvest^ ™ ^ experimenter's 

trainina'the 'exDer?mLtP ^’‘P®"ment in person perception in which, after 
to the fact that^nnlv it P""“Pal investigators called their attention 

■he 7“'' 

s2“ 

There were 15 male experimenters who conducted the person perception 
experiment with a total of 60 female subierts TUn n. Pa^oepiion 

whose principal investigators had made ttalelf no 
rnHiirn nliio.Lu , ^ 1 nonscious about their pro- 

cedure obtained ratings of persons as significantly less successful (mean = 
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tion experiment. Multy’s experiment (1962) called for the expenmenters 
to administer a pursuit rotor task to their subjects. Expenmenters had 
been trained to administer this task by having themselves serve as sub- 
jects for the principal investigator. Half the experimenters were told by 
the principal investigator that they were very good at the perceptual-motor 
skills involved. Half the experimenters were led to P 

formance was not a good one. There was no effect of this ^ 

performance of the experimenters- subjects. 

Ld been complimented by their principal --srigator we e perceived 
quite differently by their own subjects than were the less "p™ 

Lnters. CompUmented experimenters were seen to behave m a more mter 

ested fr - -1- 31 P = .01). more enthusiastic (r = +.24, p - .05) and 
ested (r +.il, p ), _ n,a„ner. From this it seems that even 
more optimistic (r = +.29, p _ . 02 ) m interaction with 

though the behavior of the experimenter is atlected oy 

the principal investigator, that does not always a f shows an instance 
differently*. The next, and final, study to 

in which it does (Rosenthal, Kohn, Green e , . jj’ verbal condi- 

The experimental task was a standard one or , 

tioning. Subjects constructed . snyjne “good” whenever 

basal level, were reinforced by the “P® ^9 exp^erimenters who 

first-person pronouns were empteyed. jjnient began, the principal 

contacted a total of 60 J an/ P^sona! evaluations, 

investigators gave expenmenters ind " evaluated un- 

Half the experimenters were evaluat evaluations dealt with 

favorably. Within each of i„fluenceability. Thus, half the 

the experimenter’s intelligence, hal informed that they were 

favorably evaluated expenmenters invpstipators; half were evalu- 

regarded as very intelUgent by ^“P^ Unfavorably evaluated cxperi- 
ated as resistant to mampulation y ^ principal investigators 

menters were led to believe they wer 8 . Q,hers. 

as either less intelligent or more manipu a j^ui^ principal 

Experimenters who felt mote lavu j 

TABLE 6-8 


Conditioning Ob.oined by ° 

tion of Their Principal Investigator s Evoluot, on 


evaluation 

Fovorob/e Unfovoruble 

1.3 

0.8 


Difference I P 
17 1.89 .10 

0 3 2.56 .03 


Intelligence 

Influencenbilily 


3.0 

3.1 
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expect It to Finally, we note that more self-conscious experimenters are 
judged less honest So the picture we have is of the principal investigator’s 
admonition affecting the experimenter’s behavior by making him less hkable, 
less courteous in tone, faster speaking, and more “dishonest,” by which is 
meant, probably, more subtly “pushy” or influential (The particular subtle 
influence they were probably exertmg on their subjects will be discussed 
later on m Part II It has to do with the expectancy for particular responses 
from the subject ) In an earlier chapter, that which dealt with observer 
effects, we saw that subjects, as well as observers, could be quite sensitive 
to the ‘ bias” of the experimenter and were likely to code this information 
into the category of “honesty ” The general behavior shown by these expen- 
menters is, as we have seen earlier, that kind of behavior which leads often, 
but not always, to subjects’ responding with more negative ratings of the 
success of the stimulus persons 

The results of the last three studies described show that the interaction 


with the pnncipal investigator can affect the experimenter’s interaction 
with his subjects and, thereby, the responses he obtains from them The pre- 
cise direction of the effect, however, seems difflcult to predict In the first 
study described, the pnncipal investigator’s reproof led to the expenmenter’s 
obtaining ratings of others as more successful In the second study, the more 
anxious the principal investigator was, the more successful were the percep- 
tions of others obtained by his research assistants An anxious principal 
investigator may affect the experimenter as a reproving one, so these two 
studies are not inconsistent However, we cannot assume that the more 


anxious pnncipal investigator simply made the expenmenter more anxious 
and that this altered anxiety level affected the subjects so that they per- 
success in others It must be remembered that m the discussion 
o t e e ects of experimenters’ anxiety, one study showed that more anxious 
expenmenters obtained ratings of others as more successful but another 
study showed the opposite effect 

hannpnp??n*Ih^'^ experiment, the only one in which we could see what 
maHp mnrp ^ ^^pe^i^enter-subject interaction, experimenters who were 
obtained ratm procedures by their pnncipal invesUgators 

IS . P“P'' The opposite 

ronstSwl it’ T I ‘■PP"'"'"® beermore 

exDenmenters t More self-conscious 

Z hte t e 1 t like reproved ones or 

th ht, e Tonfirie r “ P™"P^‘ investigator We are left 

restn es fZ fv" P''"® effect on subjects’ 

with the nnne n 1 ^ ^ nature of the experimenter’s interaction 

tfS , >nvestiptor We can have considerable confidence, how- 
mvt r n '’etween experimenter and principal 

investigator can affect the subjects responses in some wav 

Not all the evidence for this assertion comes from the person percep- 
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behavior was observed, either by the subjects themselves or by external 
observers of the sound films, the results do show a certain consistency 
Experimenters who, in their interaction with the Sator, were 

made to feel (1) less self-conscious, (2) more successful at the expen- 
mental task, and (3) more intelligent or less ^ 

behave toward their subjects in a more positive, hkable, 

In two of these three expenments. aU employing different tasks, this be 
havron Z part of the expenmenter probably affected the responses of 
the subjects in their performance of the experimental tasks 


CONCLUSION 

From all that has been said and shown it ““ 

great many vanables that s ^cifically under investigation 

vanables which, in a given “P®"" ^ 3 ^^ jooKs and acts, may 

The kind of person the the effect is a direct and 

by Itself affect the subject s respon 3„bject 

Simple one, but sometimes, too, the t rharacterislics 

charactenstics, task charactenstics, or si u „ ^ ^ things that 

Not only the kind of person the e^P”'“ hfs Lhavior in such 
happen to him before and dunng the “P® subjects The subject’s be- 
a way as to evoke different response subsequent behavior not only 

havior may have feedback effects on behavior, which then alters 

dnectly but also by changing the expenmenter s betiavi 

the subject’s response is conducted not only may affect 

The room in which the expen indirectly as well, by also 

the subject’s response directly but "'“5' “ . ,„[ufacts with his subject 

affecung the behavior of the expenmen aj,ers the expenmental 

Such a change m expenmenter behavior, of course. 

condiUons for the subject transact the expenmental busi- 

The expenmenter and the subj y ^ business The non- 

ness as a dyad, but often there is, ' ’ ^,bo, by what he is, and 

present third party is the pnnapa i interaction with the experi- 

what he does, and how he does it in y jubject he never comes to 
menter, indirecdy affects the ,n ways that change the sub- 

meet He changes the expenmenter s 

ject’sbehawor associated with the expenmenter, only 

Of all the possible endence has been accumulated 

those have been discussed for which ^ uaj difference Probably they 

that we may say these of''" ’ phenomena under imestigation are 

make less of a difference where th P ^^pphjsics. learning and psy- 
sery robust There "P"™'" ‘rage^obtained responses may be only 
chopharmacology m which the 6 
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investigators were significantly more successful at obtaining increased use 
of first-person pronouns by their subjects Table 6-8 shows the mean in- 
crease in the number of such words emitted from the operant level to the 
end of the experiment There was no difference in the magnitude of the 
effect associated with the particular attnbute evaluated All ten of the ex- 
perimenters who felt favorably evaluated obtained an increase in their 
subjects’ use of the reinforced words (p = 001), but only five of the nine 
who felt unfavorably evaluated obtained any increase (p = 1 00) 

An interesting additional finding was that even during the operant 
level of responding, before any reinforcements were provided, expenmenters 
obtained a greater number of first-person pronouns (mean = 9 8) when 
their principal investigator’s evaluation was favorable than when it was 
unfavorable (mean = 8 3, p = 10) This was not an artifact based on a 
relationship between the operant level and the operant to terminal block 
increase The correlation between operant level and conditioning score 
was only — 10 Perhaps an expenmenter who feels favorably evaluated by 
his supervisor makes his subjects more willing to make up more person^ 
statements, quite apart from being a more effective reinforcer 

In this study, subjects were asked to desenbe their expenmenter’s 
behavior m a senes of 28 rating scales Table 6-9 shows the larger correla- 

TABLE 6-9 


Experimenters' Behavior as a Function of Favorable 
Evaluation by Their Principal investigator 


Variable 

Corre/ot/on 

P 

Casual 

+.33 

.01 

Courteous 

+ 27 

05 

Pleasant 

+ 24 

08 

Expressive-voiced 

+ 24 

08 

Trunk activity 

- 26 

05 


frorableTess 

coSld reasonab v charactenst.es 

could reasonably make him a more effective remtorcer and a person for 

“er r"""” r - c^nstr^cS 

aenon w h ,b mconsis ency of the effect of a principal investigator's mter- 

mterp Jnn b t was noted It IS 

mteresung, however, that in those three studies in which the expenmenter’s 
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seen earlier that this does happen when the experimenter is aware, and 
usually he is, which subjects are undergoing which different treatments. 
To use two experimenters, one for each treatment condition, of course, 
confounds any effects of the experimenter \rith the effects of the treatments, 
so that an assessment of treatment effects is impossible. Any method that 
makes it less likely that experimenter effects will interact with treatment 
conditions would reduce our problem of assessing adequately the effects 
of our treatment conditions. More will be said of this in Part III, but for 
now, the not very surprising conclusion is that for the control of the effects 
of experimenter attributes, as for the control of the other effects discussed 
in earlier chapters, we must rely heavily on the process of replication. 
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tnvially (even if “significantly” in the statistical sense) affected by the 
expenmenter’s attributes Increasing dosages of ether are more likely to 
produce unconsciousness, regardless of the attributes of the experimenter, 
though the shape of the curve may be altered by his unique characteristics 
and behaviors Most of the behavioral science research carried out today 
IS of the “50 subjects, p = 01” type That means, of course, accounting for 
something hke 13 percent of the variance in subjects’ responses from a 
knowledge of our treatment conditions or a reduction in predictive errors 
of about 6 percent Because the effects of our independent variables, though 
unquestionably “real,” are usually so fragile, we must be especially con- 
cerned about the effects of expenmenter attributes 

The methodological imphcations of the expenmenter effects discussed 
will be treated more fully in Part III Only a few points need be mentioned 
here First, very little has been said so far about the effects of experimenter 
attnbutes on the “results of research ” Generally the wording has been 
in terms of effects on the subject’s response Such effects may alter the 
the “results of research,” but they may not In that research which seeks 
to estimate a population mean from the mean of a sample, expenmenter 
effects do change the “results of research ” Examples include much of the 
work performed by survey research organizations If we want to estimate 
the average degree of favorableness to a national policy, a well-dressed, 
high-status-appearing, older gentleman is likely to draw responses different 
from those obtained by a more shabbily dressed, bearded young man 
presumed to be from a nearby college If we want to standardize a new 
test 1 e , estimate the national mean and standard deviation — or do sex 
ehavior surveys, the results may be affected directly by the expenmenter’s 
e ects on his subjects responses But much, perhaps most, psychological 
research is not of this sort Most psychological research is likely to involve 
t e assessment of the effects of two or more expenmental conditions on 
the responses of the subject If a certain type of expenmenter tends to 
o ain s ower earning from his subjects, the “results of his experiment” 
are affected not at all so long as his effect is constant over the different con- 
I ions 0 t e experiment Expenmenter effects on means do not necessarily 
imply effects on mean differences 

In the survey research or test standardization type of research, the 
data tend to be collected by many different intervie^rs, examiners, or 
penmenters We may be fortunate, and m the given sample of data 
collectors the various effects due to their characteristics or experiences may 

trZT, " n there is a tendency 

or the condors to be selected on stnet entena, implicit or explicit, in 
such a way that the N different expenmenters are more nearly N times the 
same expenmenter There will be more to say about this in Part III 

In the laboratory experiment, the effect of a given expenmenter at- 
tribute or experience may interact with the treatment condition We have 
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spondents are not randomly assigned to interviewers, the same problem may 
result. Thus, if interviewers are each assigned a sample of respondents 
from their home neighborhoods, the opinions of interviewers and respond- 
ents are likely to come precorrelated, because opinions are related to 
neighborhoods. If, however, respondents are randomly assigned to inter- 
viewers, and if errors of observation, recording, and coding can e 
eliminated, at least statistically, the resulting correlation between inter- 
viewers’ opinions and their respondents’ opinions provides a good measure 
of modeling effects. Evidence for the phenomenon ® 

effects has been discussed and summarized elsewhere (Hyman et^ 1954 
Maccoby & Maccoby, 1954). Here it will do to note that, in son^e o the 
many relevant studies, modeling effects were found to occur and m otos 
they were found either to occur not at all or only ‘"''‘"“y.' 
effects have been found, they have ordinarily been positive^ That is he 
subjects’ responses have tended to be similar in dTCCtion to hose “^ h 
intirviewer. In a minority of cases, however, the ^ 
own opinion or ideology have been negative, so a ] 
a direction significantly opposite to that favored y 
self (Rosenthal 1963b)_ of 

An early study by Clark (192/1, wn jubjects how 

positive modeling effects. Two interview q ,• ities One of the 
much of their time was devoted to ^e oaT anrhe found 

interviewers was more athletically j spent in athletic 

that his subjects reported a greater a athletic interviewer, 

activities than did the subjects contac or observer, recorder. 

It is possible that the sampling P"’”’’’®”'® j niodeling effect. It seems 
or interpreter effects accounted for "d mojehng 
equally reasonable to think ‘hat m t e pr^^ ^.^^p^njants actuaUy gave 

pearing and behaving ‘ ile in this interviewer’s presence they 

more athletic responses. Perhaps wmi which they did engage, 

were better reminded of the ^atms “propel to 

Or it could also have been that it se ^ campus. On 

be more athletic in interaction with ujoher status, and we have seen 

many campuses, an athlete is attri ule a ,o give more 

in our discussion of this attnbute that sub « 

“proper” responses to higher status a ® . uapy interesting (1954). 

A more recent study reported by ,5^0 

The data were collected by the j„cription of a proposed motion 
Respondents were given a very r whether they would like to see 
picture plot and were asked to s a female interviewers to contact 
such a movie. There were both ma e by interviewers depended 

the male and female subjects. Respons nefhaps, on the respondent s 

significantly (p < .005) ”"rs would, because of their sex, 

inference of what movies the intervi 
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In this chapter the discussion will turn to an “attribute” of the 
experimenter which, like those considered just before, is also defined in 
terms ol the particular experiment being conducted That attribute is the 
performance of the expenmenter himself of the same task he sets his sub- 
jects For some experiments, then, this expenmenter attribute will be a more 
enduring characteristic, such as intelligence or authoritarianism For other 
experiments, this attnbute will be a less enduring one, such as an opinion 
on a timely public issue, though such less enduring attnbutes may often be 
related to more enduring ones When there is a significant relationship 
between the experimenter’s own performance of the particular task he 
requires of his subjects and the performance he obtains from his subjects, 
we may speak of an experimenter’s “modeling” effect The evidence for 
this effect comes from the literature of survey research, clinical psychology, 
and laboratory experiments 


SURVEY RESEARCH 

ofF f survey research, many investigators have assessed the 

effect of the intemewer’s own opinion, attitude, or ideology on the re- 
sponses obtained from respondents The basic paradigm haf been to ask 
the interviewers who are to be used in a given project to respond to the 
quesuonnaire themselves The responses these mterviewers subsequently 
obtain from their respondents are then correlated with their own responses 
The correlation obtained becomes the estimate of opinion bias or ideology 
The interpretation of such a correlation is not, however, always 
straightforward If interviewers are allowed any choice in the selection of 
in erviewees, they may simply be selecting hke-minded respondents If 
interviewers are not allowed any choice in interviewee selection but re- 
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therapists saw significanUy more movement themselves. Patients seen by 

the relatively more color-perceiving therapists saw significantly more color 

after treatment. This is exactly the sort of evidence required to estabhsh 

modeling effects in the psychotherapeutie relationship. There is of course 

considerable literature on the effects of psychotherapy, and when changes 

have been shown to occur, the behavior of *e 

like that of his therapist. This body of evidence is 

consideration of modeling effects. The reason is that 

behavior to be more “normal” than their patients "ft foUow 

improvement as a change toward more norma e a , 

that patients change their behavior in the p^o^ded 

behavior when they improve. Therefore, evidence f *1 that Ss 

by Graham is required. What must be shown is 

bLme more like therapists, but that they b-ome ‘heir 

particular therapist than does ° ® therapist comes from 

Further evidence for ^“‘‘eling offers of to 
the work of Bandura. Lipsher. and Md ( ’ p), their patients’ 

directly hostile therapists were more hey tp avoid their 

hostility, whereas less directly hostile t erapi . material, then, 
patients’ hostility. The approach or ^jth topics involving 

tended to determine the patient’s subsequent detog i«th < 
hostility. Not surprisingly, when therapists tended to 
patients tended to drop it as well. already been cited 

Th. .1 .!« 

(Matarazzo. Wiens. & Saslow. 1965) course, was 

of the subject on his experimenter s top°n ’ ’ interview, 

material quite incidental to their interest in compelling. It seems 

The amoL of evidence they have ‘ ' aldng time of 

clear, as one example of their work, that ‘ a^g of the 

the interviewer are followed by increases i Service employment, 

subjects, who in this case were 60 apphean s average length of 

Table 7-1 shows the increases and and decreases in the 

subjects’ speaking time as a function o i target values the 

interviewer’s speaking time. (The first co u ^ successfully.) The 

interviewer was trying to achieve, by an length of utterance 

rank correlation between changes in t e i i 976 (p < .001). On 

and his subjects’ changes in length of j. six times longer ton 

the average, subjects’ length of utterances patterns of be- 

those of the interviewer. But clear y, r the blueprint for how the 
havior shown by the interviewer can 

subject should respond. , Heller Davis, and Saunders 

Similar results have been reported ^ .^^^ars to talk with a total 

(1964). There were 12 graduate s'"'*"' instructed to behave m a 
of 96 subjects. Half the interviewers were 
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themselves enjoy One of the film plots described was that for Lawrence 
of Arabia ” When male and female subjects were asked about this film 
by interviewers of their own sex» male subjects were 50 percent more 
often favorable to the film than were female subjects However, when the 
interviewer was of the opposite sex, male subjects responded favorably only 
14 percent more often than female subjects It appeared plausible to 
reason that subjects responded by “prefernng” those movies which, judg- 
ing from the sex of the interviewer, they thought would be preferred by 
them 

It is interesting to raise the question of whether subjects of field 
research or laboratory research tend, in general, to respond in such a way 
as to reduce the perceived differences between themselves and the data 
collector with whom they interact No answer is available to this question 
at the present time, and surely it is highly oversimplified, as an assertion 
It may, however, be a reasonable one if both the participants* attributes 
and the nature of the data collection situation are considered From all 
we seem to know at present, these factors are all likely to interact with the 
subject’s motives to be less different from the data collector Two sources 
of such motives are obvious One is the wish to be similar m order to smooth 
the social interaction The other is the wish to be more like a person who 
very often enjoys, either continuously or at least situationally, a position of 
higher status To “keep up with” that Jones who is a data collector, one 
must behave as one believes a Jones would behave in the same situation 


CLINICAL PSYCHOLOGY 

‘S said of clinical psychological interactions that the clinician 
^ ^ IS patients somewhat after his own image When the clinical inter- 
Pfo^^’acted one of psychotherapy it seems especially easy to 
Siihicr-fs ^ effects may occur It it seemed plausible to reason that 
woiitd th” tended to respond as they believed the experimenter 

the “snhierf' plausible to argue that such effects occur when 

suhieet In o “ P^hent who may have all the motives of the experimental 
of hone th ^ manner and in addition, the powerful motive 

exoeZem h f G^^ham (1960) reports an 

Z mmol n m Ten psychotherapists were divided into 

the ^rschaeh M I perceptual style of approach to 

m the ink hi °i^ ^ therapists tended to see more movement 

tended toM 1’ r temaming therapists, who 

eiBht months **’ therapists saw a total of 89 patients for 

Iwo Ziol f Rottchachs administered to the patfents of the 

matS he n r?’" before treatment After 

treatment the patients seen by the relatively more movement-perceiving 
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therapists, interviewers, and experimenters as to how closely they must 
follow a given program or plan. In all the studies described so far, the 
clinicians were relatively free as to what they could say or do at any time. 
In the studies by Matarazzo and his colleagues only the length of each 
utterance was highly programmed, not the content of the utterance. In 
the studies by Heller and his colleagues the degree of dominanee and 
friendliness was programmed into the stimulus persons, they, too were 
free to vary other aspects of their behavior as they felt it to be requited. O 
even greallr relevant, then, to an understanding of the effects o the more 
highly programmed experimenter is the study of the effects of t P Y 
chological examiner. The manuals for the “^I'lfexneri 

tests are often as explicit as the directions given to a “P"" 

menter in a laborato^. The reduced freedom of the 
experimenter to behave as they would should reduce the magnitude of 

modeling effects, or so it would seem. h.arinp on 

One experiment employing psychological examiners 
the consideration of modeling effects, was earned out by Berger 1954^ 
All eight of his examiners had been pretested “‘he ^orschach^ After each 
of the examiners had administered the '“h'/cSes on 

relations were computed between the examiners o 

..d to topo.«. ’ "SivIS SS 

between the examiners scores and their subj , obtained 

tended to organize their percepts into those vep' . , . gg _ _ qI). 

more such popular percepts from their subjects 

Examiners who tended to use the white space o +.80, 

obtained from their subjects a greater use of such white space (r/m 

p — .03). effects in the more standard clinical 

Another example of modeling Sanders and 

interaction of Psy‘=^°’°Ei“' ^h was the test administered. All 
Cleveland (1953). Again the admin- 

9 of the examiners were given the Rorsc , examiner and for 

istered the Rorschach to 30 subjects eac . Rorschach hostility score 
each subject a Rorschach 

were computed. There was no re a i P Rorschachs he 

anxiety level and the mean anxiety whose own hostility scores 

obtained. However, those three examiners 

were highest ,l,ree examiners whose own 

hostility scores werelowest (mean - discussion of modeUng 

Two more informal King, and Drolette (1957) 

effects found in clinical settings. F ^gons to stress in which it was 

were engaged in a clinical experiment on majt^ 0,,;, 

necessary to test patients, j* r 
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TABLE 7-1 


Subjects' Changes in Duration af Speech as a Func- 
tion of Interviewer's Changes (After Matarazzo, 
Wiens, & Saslow, 1965, p. 199) 


CHANGES IN SPEECH DURATION 


Interviewer's 



Target 

Interviewer 

Sub/ect 

+200% 

+204% 

+109% 

+100 

+94 

+111 

+100 

+87 

+93 

0 

+4 

+2 

0 

0 

-8 

-50 

-38 

-43 

-50 

-48 

-45 

-67 

-64 

-51 


verbally more active manner, and halt were instructed to be less active 
verbally Dunng every minute of the 15 minutes recorded, subjects spoke 
more it their interviewer had been more verbally active than it he had been 
less verbally active Subjects contacted by more talkaUve interviewers 
spent about 16 percent mote time in talk than did their peers assigned to 
mote laconic interviewers (p < 02) In another connecUon we cited the 
wor 0 Myers, and Vikan-Kline (1963) Now we need only a 

findings relevant to the present discussion Friendlier 
lens (experimenters) evoked friendlier interviewer (subiect) behavior, 
f More dominant “cheats” evoked 

inn interviewer behavior, an example not only ot negative model- 

exoerimenin " ^ that interviewers, and presumably also 

lust as ibpse'^’ ^ouietimes be modeled by their “clients” or subjects 
There ,s " ” or experimenter 

examnles nf mnuT*' >n which the studies descnbed so tar are not true 
of such effects tT,'”® effects, though they are relevant to a consideration 
assessed at exacllv^r''*™ therapists or interviewers were not 

interviewees nr snh ^ purtormance at which their patients, 

viewer himself The '***^**'*’ "f' n^t^^sstirily by the inter- 

rartherh V I 7, T =■“ tn^tmctive, however, m showing 

rcEsms fv h hi ' "''’'‘gR *= tire still unsle of the 

mechanisms by which these effects operate 

There is a difference, of course, m the degree of structure provided for 
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From this it follows — and perhaps this should be more systematically in- 
vestigated — that experimenters who themselves believe m ESP may, by 
affecting their subjects’ belief, obtain superior performance at ESP tasks 
than do experimenters not believing in ESP 

Most of the research explicitly designed to assess the modeling effects 
of the data collector has come from the field of survey research, some 
has come from the area of clinical psychological pracUce, and, until very 
recently, virtually none has come from laboratory settings In part, the 
reason for this may be the greater availability for study of the 
of field research and even of clinicians compared to the availabihty for 
study of laboratory experimenters But that does not seem ^e the wh^k 
story There is a general belief, perhaps largely justified, that the greater 
“rough-and-tumble” of the field and of the clinic might naturally lead to 
increased modeling and related effects The behavior of he >nte™^r 
and of the clinician is often less precisely programmed than ^avio^ 
the expenmenter in the laboratory, so that their “"'"f f 
their subjects and patients could come about more readily 
It IS often believed, these unintended effects are less ''k^ecaus of he 
more explicit programming of the experimenter s behavior The words ex 
penmen^r behavfor” are better read as “instrucuons to subjeetC nee h s 
I usually the only aspect of the expenmenter’s behavm that is lugh y 
programmed Sometimes, when the experimenter ■/ to P ^y « to' ; he s 
told to be warm or cold, and then other “pro- 

programmed, but still ^ty 

gram the experimenter so that there win o i' nreciselv 

fubjects We'^cannotdo.hisprogram^^^^^ 

what the behavior is that makes the d _»ntpr were literally an 

to respond differently than they would if the too 

automaton In the light of these L^m Te labomtoiy as 

surprised to learn that reason to believe that even 

well as in the field and in the clinic pxnenmenters in laboratories 

with instructions to and as umntenUonally, as 

cannot influence their subjects a , settings Furthermore, 

interviewers in the field or dinicia th^^ ,„(erpersonai® commumcation 
there is no reason to JOPP®'; . ,„(,uence are any different in the 
processes that mediate the “"‘O*®" , interpersonal re- 

laboratory than they are in the fie , or in ^ evaluation of the 

lationships generally At present, " For a fuU under- 

oecurrenee of modehng effects in ,he results of re- 

standing of how these effects operate, we must wait 

search perhaps not yet begun specifically designed to assess 

There is a senes of nine ,n a laboratory setting 

the occurrence and magnitude o and 1964, employed the 

This series of studies, conducte 
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responses However, one of the experimenters found himself filled with 
doubts and anxieties about the studies undertaken Every patient tested 
by this experimenter showed severe anxiety responses Finally, the 
classic study of Escalona (1945) is cited to illustrate that the effects 
under discussion do not depend on verbal communication channels The 
scene of the research was a reformatory for women in which the of- 
fenders were permitted to have their babies There were over 50 babies 
altogether, and 70 percent of these were less than one year old Part of the 
feeding schedule was for the babies to be given orange juice half the time 
and, on alternate days, tomato juice Often the babies, many under four 
months of age, preferred one of these juices but disliked the other The 
number of orange juice drinkers was about the same as the number of 
tomato juice drinkers The ladies who cared for the babies also turned out 
to have preferences for either orange or tomato juice When the feeders 
of the baby disliked orange juice, the baby was more likely to dishke 
orange juice When the feeder disliked tomato juice, the baby similarly 
dishked tomato juice When babies were reassigned a new feeder who 
preferred the type of juice opposite to the one preferred by the baby, the 
baby changed its preference to that of its feeder 


laboratory experiments 

A number of laboratory studies mentioned earlier have suggested that 
even in these somewhat more highly structured interactions, modeling effects 
may occur Thus Cook-Marquis (1958) found that high-authontanan 
experimenters were unable to convince their subjects of the value of 
nonau oritanan teaching methods Presumably, such expenmenters could 
?pivpc°f ^ persuade subjects to accept communications they them- 
Barnard’s work (1963) similarly suggested the 
found thiit ^ effects He used a phrase association task and 

associafivp rT experimenters showing a higher degree of 

subiectc rnnt^ showed a higher degree of disturbance than did 

before siirh ^ ^ experimenters showing less such disturbance Even 

Lsted that F Allport (1955) had sug- 

tionally, his own"' apprasIroT'fc 

suggestion 

ler and'McCOTndf (r9S8)°has''''*™H“L^ perception the work of Schmeid- 
belief in the nhenn \ ^iscd the question that the experimenter’s 

TthL a en "i.™ subject’s behef in ESP 

at ESP tasks Subject Tho believe KP ‘t^be r"h'’ ’’"f 'Tto 

perform better than subjects who believe ESP fo'bfimpo^iWe (“gLs”) 
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TABLE 7-2 


Modeling Effects in Studies of Person Perception 


Experimenf 

1. Rosenthal and Fode (1963b) 

2. Hinkle (personal communication, 

1961) 

3. Rosenthal, Persinger, Vikon- 
Kline, and Fode (1963a) 

4 Rosenthal, Persinger, Vikan- 
Kline, and Fode (1963b) 

5. White (1962) 

6. Rosenthal, Persinger, Vikan- 
Kline, and Mulry (1963) 

7. Persinger (1962) 

8. Rosenthal, Persinger, Mulry, 
Vikan-Kline, and Grothe 
(1964a; 1964b) 

9. Haley and Rosenthal (unpublished, 

1964) I , . 

Haley and Rosenthal (unpublished 

1964) II 
Total 


Correlation 

N 

+.52 

10 

+.65 

24 

+.18 

12 

+.31 

18 

-.07 

18 

-.32 

26 

-.49 

12 

+.14 

25 

-.18 

9 

+.54 

7 


161 


Which turned out to he negaUve ^ 

portions of vanance in subjects me p experimental task 

knowledge of the experimenters’ ^2 percent. Sometimes, then, 

varied from less than 1.P"“°‘ ^ a finding consistent with the 
modeUng effects are Thf^ ,he opinion of the interviewer 

results of the survey research hterat . When there is a difference, 

sometimes makes a difference and sometimes not. When there 

it is sometimes sizable sometimes trw. experi^ments 

Examinauon of Table 7 ^ ® , he correlations obtained 

there is a fairly regular dK^ase m ^ the first eight studies 

(p < .05). The interpretation of this uenu n g „„riments were con- 

is speculative. Over the "jnerease that experimenters might 

ducted, the probabiUty would se interest. This recognition may 

learn that they themselves were th . effects on their subj'ects. By 
have led to their trying to avoid ‘>“3' behavior that leads to positive 
trying too hard, they may have reversed the benavio 
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person perception task already described Subjects were asked to rate a 
senes of 10 or 20 photos on how successful or unsuccessful the persons 
pictured appeared to be In all nine studies, expenmenters themselves rated 
the photos before contacting their subjects This was accomphshed as part 
of the training procedure — it being most convenient to train expenmenters 
by having them assume the role of subject while the pnncipal investigators 
acted in the role of expenmenter For each study, modeling effects were 
defined by the correlation beween the mean rating of the photos by the 
different expenmenters themselves and the mean photo rating obtained by 
each expenmenter from all his subjects The number of expenmenters (and 
therefore the N per correlation coefficient) per study ranged from 10 to 26 
The number of subjects per study ranged from 55 to 206 The number of 
subjects per expenmenter ranged from 4 to 20, the mean falling above 
5 In all, 161 expenmenters and about 900 subjects were included 

All expenmenters employed m the first eight studies were either grad- 
uate students or advanced undergraduate students in psychology or guid- 
ance In the last expenment, there were two samples of expenmenters One 
consisted of nine law students, the other was a mixed group of seven graduate 
students pnmanly m the natural sciences Subjects were drawn from ele- 
mentary college courses, usually from psychology courses, but also from 
courses in education, social sciences, and the humanities All of the experi- 
ments were designed to test at least one hypothesis about expenmenter 
effects other than modeling effects — as, for example, the effects of expen- 
menters’ expectancy All studies, then, had at least two treatment con- 
itions, the effects of which would have to be partially transcended by 
modeling effects 


. 7-2 shows the correlation {rho) obtained in each of the nine 

s u es etween the experimenters’ own ratings of the photos and the mean 
rating they subsequently obtained from their subjects The correlations are 
-i! M ^ which they were obtained so that the experiment listed 

as No 1 was the first conducted and No 9 the last There is a remarkable 
T ? correlations, the range being from - 49 to + 65 

(Taken individually, and with the df based on the number of experimenters, 

ratn < 10°l"Th ““'I stgutflcantly from zero 

notMever experiment No 2 was 

cnbed bv kneHc closer study) Employing the method des- 

relations^are from^th ' assessing the likelihood that a set of cor- 
relations are from the same populatton, the value of x= was 23 52 (df = 9, 

yielded x= of 13 "^ata from experiment No 2 

rMeren, stiidl ‘ ^^ults that 

vanable riiren n perception task there may be 

imion en^el T ^ f “ chance fluctuation from a popu- 

lation correlatmn of zero Disregarding the direction of the correlLons 
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and involved both vocally and motoncally It seems well estabhshed that, 
at least for these particular samples, the lawyers and graduate students 
treated their subjects differently, but there is nothing m the pattern of 
differences to tell us how it may have led to differences in modehng effects 
Later, in Part II, we shall see that, if anything, this pattern of behavior is 
associated with greater unintended effects of the experimenter, though those 
effects are not of modeling but of the expenmenter’s expectancy 

Among the first eight experiments there was one (No 8) that had 
been filmed Unfortunately, this was an experiment that showed virtually 
no modehng effects Still it might be instructive to see what the behavior was 
of experimenters who themselves rated the photos as being of more 
successful people At least in some of the studies such behavior may affect 
the photo ratings of the subjects 

Dunng the bnef premstructional penod of the experiment, there was 
little experimenter behavior from which one could postdict how he had 
rated the success of photos of others Those who had rated the photos as 
more successful were judged from the film alone to behave less consistently 
(r = — 40, p < 10) than those who had rated photos as of less successful 
people Such a single relationship could easily have occurred by chance, 
however Dunng the instruction-reading phase of the expenment, ob- 
servers who saw the film but heard no sound track judged more success- 
rating experimenters as less enthusiastic (r = — 42, p= 08) These 
experimenters were judged from the sound track alone to behave in a more 
self-important manner (r = -b41, p< 10) Observers who had access 


TABLE 7-4 


Experimenter Behavior and the Perception of Success 
of Others 


Variable 

Corre/offon 

P 

Personal 

- 42 

08 

Interested 

- 40 

10 

Expressive face 

_ 44 

07 

Fast speoking 

+ 51 

03 


t6 both the film and sound track made Ihc most judgments found to correlate 
With the experimenter’s own perception of the success of others Table 7-4 
shows the larger correlations Relatively more succcss-pcrcciving experi- 
menters seemed less interested, less expressive, and faster speaking than their 
less success perceiving colleagues Ordinarily we expect such behavior to 
result in subjects subsequently rating photos of others as less successful, and 
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modeling effects m such a way that negative modeling effects resulted In 
a later chapter, dealing with the effects of excessive reward, some evidence 
will be presented that suggests that such ‘ bending over backward” does 
occur 

The last study listed m Table 7-2 shows that, even within the same 
experiment, the use of different samples of expenmenters can lead to dif- 
ferent directions and magnitudes of modeling effects Among the nine 
law students there were no large modehng effects, and the tendency, if 
any, was for negative effects Among the seven graduate students, who 
were primarily m the physical sciences the tendency was for larger and 
positive, though not significant, modeling effects The two correlations 
could from statistical considerations alone have been combined, but 
because it was known that these two samples differed in a number of 
other characteristics, this was not done The law student experimenters, for 
example, themselves rated the photos as being of more successful people 
(rpi = 57, p < 05), and from their written statements of the purpose 

of the expenment were judged more senous (r = -j- 62, p < 02) and less 
suspicious that their own behavior was under study (r = — 74, p < 005) 
This last finding argues somewhat against the earlier interpretation that as 
expenmenters were more likely to be suspicious of being studied they would 
tend to bend over backward to avoid modeling their subjects 

The lawyers behavior during the experiment also seemed to be dif 
ferent from that of the mixed sample of graduate students Table 7-3 
shows the larger point bisenal correlations between subjects’ ratings of their 
expenmenters and experimenters’ sample membership The young at- 
torneys were judged by their subjects to be friendlier and more active 


TABLE 7-3 

Experimenter Behavior Distinguishing law Students 
from Graduate Students 


Vario6/e 
Friendly 
Pleasant 
Likable 
Interested 
Pleasant voiced 
Loud 

Hand gestures 
Head activity 
Leg activity 


Corre/ation 

P 

+ 37 

001 

+ 26 

02 

+ 23 

05 

+ 30 

01 

+ 43 

001 

+ 24 

05 

+ 24 

05 

+ 27 

02 

+ 30 

01 
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to show negative modeling effects and for expenmenters who had been 
unfavorably evaluated, especially as to their intelligence, to show positive 
modeling effects (In the earlier discussion of the effects of evaluation by the 
principal investigator, it was mentioned that, in this particular expenment, 
the favorably evaluated experimenters were the ones who also obtained the 
significantly greater amount of conditiomng from their subjects) 

The experiment under discussion and that conducted with Haley are 
the only ones within which compansons are made between different sets of 
expenmenters The favorably evaluated expenmenters of the one study, and 
the lawyers of the other study, both showed negative modehng effects, and 
both were evaluated by their subjects as more mterpersonally pleasant The 
unfavorably evaluated experimenters and the natural scientists both showed 
positive modeling effects and were both evaluated generally as less pleasant 
This consistency between the two studies was especially heartening in view 
of the fact that the two studies employed different tasks, sentence construc- 
tion in the one case, person perception in the other 

It may be that subjects evaluate as more pleasant those expenmenters 
who are not unintentionally influencing their subjects to respond as they 
would themselves respond Or it may be that experimenters who are “really” 
more pleasant mterpersonally, either charactenstically or because they 
have been made that way by their interaction with the pnncipal investigator, 
bend over backward to avoid modehng their subjects, while less favorably 
evaluated expenmenters and those charactenstically less pleasant mter- 
personally behave in such a way as to obtain positively modeled responses 
This interpretation can be apphed to the senes of person perception studies 
which showed modeling effects to become more negative over time In most 
of these studies there were one or more principal investigators who were 
involved with several of the studies Perhaps as the pnncipal investigators 
gained more expenence in conducting such experiments they became more 
relaxed and pleasant toward the expenmenters, so that, unintentionally, 
expenmenters of the later studies felt less tense and less “on the spot” than 
expenmenters of the earlier studies Such unintentionally increased comfort 
on the part of the expenmenters in later studies could account for an in- 
crease in their pleasantness toward their subjects, an increase that, in one 
way or another, seems to lead to negative modehng effects 

From all the evidence considered, it seems sensible to conclude that 
modeling effects occur at least sometimes in psychological research con- 
ducted in field or laboratory We find it difficult, however, to predict the 
direction and magnitude of modehng effects In survey research, they tend 
usually to be positive but vanablc as to magnitude In laboratory studies, 
modeling effects arc variable not only in magnitude but in direction as well 
The interpretation of the variability of direction of modeling effects that is 
best supported by the csidencc, though still not well established, is that a 
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if that had occurred there would have been a negative modeling effect In- 
stead, there was virtually none at all, a little positive if anything In the study 
conducted in collaboration with Haley, these general results were reversed 
At least as defined by subjects’ ratings, those experimenters who rated the 
photos as more successful behaved m a more friendly (r = -f- 25, p = 02) 
manner We are left knowing only that the behavior of experimenters rating 
photos as of more successful persons differs significantly, but not consist- 
ently, from the behavior of less success-perceiving expenmenters Tritely but 
truly put, more research is needed 

There is a more recently conducted experiment, in which the task 
was to construct sentences beginning with any of six pronouns (Rosen- 
thal, Kohn, Greenfield, & Carota, 1966) The procedures called for the 
experimenter’s saying “good ’ whenever the subject chose a first-person 
pronoun But before these reinforcements began, subjects were permitted 
to generate sentences without reinforcements, in order that an operant 
or basal level could be established Before experimenters contacted their 
subjects they, too, constructed sentences without receiving any reinforce- 
ments Modeling effects are defined again by a correlation coefficient, this 
time between the experimenter’s operant level of choosing to begin sentences 
with first-person pronouns and his subjects’ subsequently determined oper- 
ant levels This was the experiment, described earlier, m which the experi- 
menters were subtly evaluated by their pnncipal investigator Half the 
expenmenters were evaluated on their intelligence, half on their influence- 
a I ity Within each of these groups half the expenmenters were evaluated 
avora y, alf unfavorably Table 7-5 shows the correlations representing 
mo e ing effects for each of the four groups of experimenters There was 
a general tendency for experimenters who had been favorably evaluated 


TABLE 7—5 


Modeling Effects of Experimenters as a Function of 
Their Principal Investigator's Evaluation 


Attribute 
Intel] igence 
Influenceabiltty 

Weon 


evaluation 


Fovorob/e 

Unfavorable 

- 88* 

- 74 

+ 997** 

+ 03 

- 81* 

+ 52 


z dliference p 

3 58 0005 

98 — 

2 24 03 


*P< 05 

**p< 005 
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The preceding chapters have dealt with the effects of vanous attributes 
of the experimenter on the responses he obtains from his subjects Some of 
these attributes were quite stable (le, the sex of the expenmenter) and 
some were quite situational (le, the experiences the expenmenter en- 
countered while conducting his expenment) In this chapter, the discussion 
turns to another “attnbute” highly dependent on the specific 
being conducted-the expectancy the expenmenter has of how his subjects 
will respond Much of the remainder of this book deals with this vanable 
In Part II the emphasis will be on the expenmental evidence s“pp°^ 
the proposition that what results the expenmenter obtains from his subjects 
may be determined in part by what he expects to obtain I" 
emphasis wdl be on vanous methodological implications of Prjosiho 
including what may be done to minimize the unintended effect of the 

’’“Ta^r .Uatio^ a scientist has of how 
turn out IS vanable, depending on the expenmen being 
presence of some expectation is virtually a 

pendent and dependent vanables selected for s “ ^ selected because 

chosen by means of a table of random numbers They ara se leemd becau e 

the seienhst expects a certain relationship to appea between them Even m 

those less c Jully P'"— 

expeditions or, more ^mally p ^ vanables 

tures, do not take place m to affect the choice of the 

These expectations o ® ^ to increase the hkeli- 

sr 
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happier, more pleasant, less tense expenmenter seems to model his subjects 
negatively The less pleasant, more tense expenmenter seems to model his 
subjects positively Just why that should be is not at all clear 

Problems in the control of modeling and of related effects of the expen- 
menter will be treated in Part III One methodological implication follows 
from the possible relationship between the direction of modeling and the 
pleasantness of the experimenter’s behavior If a pleasant experimenter 
models negatively and an unpleasant expenmenter models positively, then 
perhaps a more nearly neutral experimenter models not at all If research 
were to show that this were the case, we could perhaps reduce modeling 
effects either by the selection of naturally neutral experimenters oi by in- 
ducing more randomly selected experimenters to behave neutrally If our 
selection of expenmenters were fairly random with respect to the charac- 
tenstic of pleasantness, and if we did not systematically change our as- 
sistants’ degree of pleasantness m our interaction with them, we might hope 
for the modeling effects of the more and less pleasant data collectors to 
cancel each other out Replication, therefore, is required for the assessment 
and control of an effect of the expenmenter 
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That one person’s expectation about another person’s behavior may 
contribute to a determination of what that behavior will actually be has been 
suggested by various theorists. Merton (1948) developed the very appropri- 
ate concept of “self-fulfilling prophecy.’’ One prophesies an event, md the 
expectation of the event then changes the behavior of the prophet in 
a way as to make the prophesied event more likely. Gordon AUport (1950) 
has applied the concept of interpersonal expectancies to an analysis of the 
causes of war. Nations expecting to go to war affect the behavior of them 
opponents-to-be by the behavior which reflects their expectations of anned 
conflict. Nations who expect to remain out of wars, at least sometimes, 
manage to avoid entering into them. 


EXPECTANCY EFFECTS IN EliERYDAY LIFE 

A group of young men, studied intensively by Whyte (1943), ‘‘knew 
how weU a Ln should bowl.” On some evenings ilie 
leaders, “knew” that a given member would bowl well. Th^ 
seemed predictive, for on such an everong t e jo 

other evmings it was “known” that a member 7"''' trap’s 
he did, even if he had been the good bowler o the week before^ The g-oup s 

expectancy of the members’ performance a ? banter offered that 

determine that performance. Perhaps the “ 

“°“AZugriVdeaUng rpecSfS the 

pectancy on another’s tells of the bicycle rider 

the century by Jastrow ( ^ coordinaUon becomes impaired and he 
who so fears that he may fall that his athletic trials, the enter- 

does fall. “So in jumping or running and__m lessens the 

teinment of notmn of a poss J d^ ii 3 j,^ant of one’s best.” 

intensity of one s effort, and prev :„»prnrptation of the effects of ex- 
We may disagree with Jastrow over h«^ ^^ip 

pectancy on ^f^^amples Jastrow did not specify that the ex- 
common experience. In these exa p another person, but as we saw 

pectancy of falling or of failing came 

in the example provided by TO^M^yo ’ case of expec- 

Jastrow also gives the , 1 ,, U„bed States Cen 

tancy effects in the world of work. machine had just been installed. 

Bureau in 1890. The Hollerith 

This machine, something analogo two-score positions to be learned 

learn some 250 positions compared to the two-s f 
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show this, he would be likely to revise his hypothesis If the selection of a 
research design or procedure is regarded by another scientist as too “biased” 
to be a fair test of the hypothesis, he can test the hypothesis employing op- 
positely biased procedures or less biased procedures by which to demon- 
strate the greater value of his hypothesis The designs and procedures 
employed are, to a great extent, public knowledge, and it is this public 
character that permits relevant replications to serve the required corrective 
function 

In the behavioral sciences, especially, where statistical procedures are 
so generally employed to guide the interpretation of results, the expectation 
of the investigator may affect the choice of statistical tests Unintentionally, 
the investigator may employ more powerful statistical tests when his hy- 
pothesis calls for his showing the untenability of the null hypothesis Less 
powerful statistics may be employed when the expectation calls for the 
tenability of the null hypothesis As in the choice of design and procedure, 
the consequences of such an unintentional expectancy bias are not serious 
The data can, after all, be reanalyzed by any disagreeing scientist Other 
effects of the scientist’s expectation may be on his observation of the data 
and on his interpretation of what they mean Both these effects have already 
been discussed m the opening chapters of this book 

The major concern of this chapter will be with the effects of the 
«penmenter s expectation on the responses he obtains from his subjects 
The consequences of such an expectancy bias can be quite senous Expect- 
subjects’ responses are not public matters It is not only 
that other scientists cannot know whether such effects occurred in the ex- 
interaction with his subjects, the investigator himself may not 
ThTt^i. occurred Moreover, there is the Iikehhood 

Considered the possibility of such umn- 
sTuatls a That .s not so diflLn, from the 

attribute of the ^ wherein the subject’s response is affected by any 


necTss ^ ^xbject’s response, they do not 

taarenfcf as a fnncLn of the subject’s 

SM oT?he T *= other hand, always do The 

ment conditiL in an ZenZnt Tte®'" “ “ '""ohon of the subject’s treat- 
« respond 

far afexpVr^’Znl^^^^^^^^^ *'’= "Soo'* Pt*"*™' 

It should be emphasized that many of Z efets of'm ’ ? 'Z 

eluding the effects of his expectanL may ht e enn d er. n- 

other social relationships ^ considerable generality for 
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In this report considerable evidence is cited which shows that the culturally 
deprived child shows a relative drop in academic performance and IQ as he 
progresses from the third to the sixth grade Until recently, however, there 
Ls been no experimental evidence that teachers’ expectations of a child s 
performance actually affect that performance Now there are data that show 
quite clearly that when teachers expect a child’s IQ to go up it does go up 
The effect is consistent, not always large, but sometimes very dramatic 
(e g , 20-pomt IQ gams) The data, not yet fully analyzed, were collected 
in collaboration with Lenore Jacobson and will be reported fully elsewhere 


EXPECTANCY EFFECTS IN SURVEY RESEARCH 

Perhaps the classic work in this area was that of Stuart ^“^29) 
A sample of 2,000 applicants tor charity were interviewed by a oi 12 
skilled mterviewers Interviewers talked individually with ‘h- 
who had been assigned in a wholly «onse ected manner 

ascribed their dependent /h“mL^ who was a 

the interviewers expectancies Thus, one ..ennnses blamins 

staunch prohibitionist, obtained three times as ” "X “ mm 

alcohol as did another interviewer regarded as a socia ist who in turn 

obtained half again as many “f in.er- 

prohibitionist interviewer respondent! who then replied as 

viewer was somehow communicated dLpreed with Rice’s mterpre- 

expected Hyman and his colleagues ( ) ® errors of record- 

-r. 

mg or of interpretation What the „,„ectancv were private ones In 

for the effects if of “f ^e research were strikingly affected 

either case, of course, the results 

by the expectancy of the data , differential expectancies 

One of the earliest Each of six boys was 

m interviewers was that conduc V The boys were to report 

interviewed by each of five you g p g Interviewers were 

to the interviewers on a story *^3' , boys’ character Each inter- 

to use these reports to form impr J ut boys’ reliability, 

viewer was given some these data in assessing the 

sociability, and stability, but to interviewers at the conclusion of 

boys Standardized questions asked of the mte^ 

the study suggested that biases of to bias Harvey felt 

viewers’ awareness and toward the boys which 

that the interviewers '’‘“S . expected and then the interpretauon 

in turn determined the behavior J ts’ responses were actually al- 

given Again, we cannot be sure that subjects P 
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m typing All regarded the task as quite difficult, and Hollerith himself 
estimated that a trained worker should be able to punch about 550 cards 
per day, each card containing about 10 punches It took two weeks before 
any clerk achieved that high a rate, but gradually, the hundreds of clerks 
employed were able to perform at even higher levels but only at great emo- 
tional cost Workers were so tense trying to achieve the records estabhshed 
that the Secretary of the Interior forbade the establishment of any minimum 
number of cards to be punched per day 

At this point two hundred new clerks were brought in to augment the 
work force They knew nothing of the work and, unlike the original group, 
had no traimng nor had they ever seen the machines These workers’ chief 
asset was that no one had told them of the task’s great “difficulty ” Within 
three days this new group of clerks was performing at the level attained 
by the initial group after five weeks of indoctrination and two weeks of 


practice Among the initial group of workers, those who had been impressed 
by the difficulty of the task, many became ill from overwork when they 
achieved a level of 700 cards per day Needless to say there was no such 
illness among the group of workers who had no reason to beheve the task 
to e a difficult one Within a short time, one of these new clerks was punch- 
ing over 2,200 cards per day 

^ person’s behavior of the expectancies others had 
^ c further illustrated in an anecdote related by the learning 

^ (1938) He told how a shy, socially inept young 

svdtpm-i'tf/'^n and relaxed m social contacts by having been 

ranped ih ^ ^ ^ favonte A group of college men had ar- 

facii contact with her so that socially 

aor (1964 r 

another’s driving, one driver’s expectancy of 

Tt™ L to tr; ' 'T to that driver automotively in such 

Education s ' ‘tf tho ottpected behavior would occur 

m which expectancy cllcVt^hawbe^ '“'‘=^‘5 of everyday life 

concern over the regarded as central With increasing 

'amagXhi drt ™ '“"“"“fly. racially, and socially disad- 

r efpcetLcroiT chM" Ptoti ‘o the effect of 

fo;rn'crSKlo„T962\“th^ ™ 

a child of a given intelligencc\«ll o^pectation is that 

confronts him, and especially if we mlK "'’'f 

child, the probability ttat he resold J , 'o’own to the 

(p 493) The same position has bec^ani/d 
(1963), and Clark (1963), who speakf 

’’the victim of an educational 5 elf-fu|fiih„r ''’\‘'=P‘'‘''=d ohild becoming 
the most detailed statement ol th” p^ 

yo,,,;i m ,),e c/ie,,o (Harlem Youth^ppor,r,:l 
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found them to be as susceptible to hypnosis as college undergraduates In 
the past, schizophrenics had been thought fat less hypnoUzable Their m- 
terpretation suggested that, relative to the older studies, their own approach 
to the schizophrenics commumcated to them the investigators’ expectancy 

that the patients could be hypnotized 

In the area of ps\chotherapy, a number of workers have been im- 
pressed by the effects of the self-fulfilling prophecy One of the best known 
of these was Fneda Fromm-Reichmann (1950) She spoke, as other clm- 
cians have, of latrogemc psychiatric mcurabihties The therapist s own behef 
about the patient’s prognosis might be a determinant of ttat P^i' 
Strupp and Luborsky (1962) have also made this point These chm^ 
impressions are supported to some extent by a few more formal invesbga- 
tir HSme and Tresman (1960) did not find the 
tauon of help to be related to his conUnuance 

however, that when the therapist and paPent had ^ ’ 

patients conPnued longer in treatment Experimental PL'^^f 

ensure such congruence have been employed by Jerome Frank and Martm 

sions, the chent’s behavior was no m P behavior The therapists 

their self-descnptions were of more in p ^dependence 

employed in this study show this decrease in dependency 

and tended to expect successful c therapists that independent-sound 

Chents may well have sened to fulfill their therapist’s 

mg verbahzations were desired a J , ,he general importance to the 

expectancy The most ^rnable /that by Gold- 

psychotherapeutic interaction of th p 

stem (1962) . ^ onlv realms of chmeal 

But hypnosis and n,ay deternune the outcome 

pracuce in which the recentlv not exceeded about 15 

The fatahty rates of dehnum tre ,jaatn,antL of greaUy varying sorts 

percent However, from time to Gunne’s work m Sweden 

are reported to reduce r,,„rterfy Journal of Studies on Alcohol 

summanzed by the staff of the Q J a jsap mortahty rate 

(1959) showed that any change in th py ,he new treatment 

One interpretation of this finding expectancy that leads to subtle 

expects a decrease in mortality rate under mvesh- 

diferenual patient care over and =>'>ove ^ 

gahon A prophecy again may havebeen self 
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tered by interviewer expectancies The possibility, however, is too provoca- 
tive to overlook 

Wyatt and Campbell (1950) trained over two hundred student inter- 
viewers for a public opinion survey deahng with the 1948 presidential 
campaign Before collecting their data, the interviewers guessed the percent- 
age distribution of responses they would obtain to each of five questions 
For four of the five questions asked, interviewers tended to obtain more 
answers in the direction of their expectancy, although the effect was signifi- 
cant m the case of only one question Those interviewers expecting more of 
their respondents to have discussed the campaign with others tended to 
obtain responses from their subjects that bore out their expectancy (p = 
02) Interviewers had also answered the five questions themselves, so that 
an assessment of modeling effects was possible These effects were not sig- 
nificant 

More recent evidence for expectancy effects in survey research comes 
from the work of Hanson and Marks (1958), and a very thorough dis 
cussion can be found tn Hyman et al (1 954) 


EXPECTANCY EFFECTS IN CLINICAL PSYCHOLOGY 

Hit. sociologist Merton who developed the concept of 

wni n ^ prophecy, particularly for the analysis of such large-scale 
f2p phenomena as racial and religious prejudice and the 

Sitlxt u earlier and m a clinical 

which "riip n spoke specifically of clinical phenomena in 

hvstenc^ fulfillmont” (p 244) Ho menfonod 

He told oHnsoninV''^"^ behoved they could be cured 

When their advent * ’ ‘^P^tence, and stammering all coming about 

Phenom ™n of hv P^rhculnr .merest wnf in the 

hevedThev Ire 0 ^°,''!. k c behaved ns they be- 

hlXusTr •“ ■" 1959. Orne showed that 

gr.es r„Xfconfil , f <''=‘*er & Cnlverley, 1964b) 

subject’s expecahou d.d not ZayttTd tot ( 1964) showed that the 
In the studies just now ...L perfonnance 

the hypnotist’s expectancy as an un.nter^H h°‘ with 

response It was more a ease of the sXrft ‘’‘='""""“1 ^“bjects 

of his own response As yet there have wpectancy as a determinant 
d.llcrent hypnotists were led to Lve dTferem'"'’°"' 
subjects’ performance That is the kind m ^ C about their 

.. 4 = 1 .1 ». i 
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tensive study of the researcher himself. “For, intentionally or not, he seems 
to exercise greater control over human behavior than is generally thought 
(p. 83). We cannot be sure that the findings reported were a case of ex- 
pectancy effect or bias. It might have been that the choice of specific 
hypotheses for testing, or that the choice of designs or procedures for test- 
ing them, determined the apparently biased outcomes. At the very least 
however, this study accomplished its task of calling attention to the potential 
biasing effects of experimenters’ expectations. 

Perhaps the earliest study that employed a straightforward expen- 
mental task and directly varied the expectancy of the experimenter was tha 
of Stanton and Baker (1942) . In their study, 12 nonsense geome nc fibres 
were presented to a group of 200 undergraduate 

days, retention of these figures was measured by ve “P™ j 

The experimenters were supplied with a key of “correct respon e , some of 
which ™re actually correct but some of which 

menters were explicitly warned to guard agmnst any ’ influencing 

their having the keys before them and ‘hereby “"'ntent.onally^^^^^^^^^ g 
their subjects to guess correctly. Results showed 

tained results in accordance with his expectations. correct than 

key was correct, the subject's response was more 1° 

when the key was incorrect. In a careful replication of th s ^"^y, Lmd^y 

keys out of the subjects view. This study 0942) also failed 

and Baker findings. Another replication y still significant 

to obtain the significance of three experiments, 

results of this sort, even occumng in onty one ° ‘ 

cannot be dismissed lightly. ^He er^lyed a set of non- 
evidence which strengthened his cone u . subiects and ten of 

sense materials, ten of which had presented 

which had not. Experimenters were ivi ^ exposed, another 

was correctly informed as to “ "Ts told nothing. The 

group was ^"rirthat th^^ materials that the experimenters 

results of this study also indicated chosen. 

expected to be more often ’ = t described was conducted in 

An experiment analogous to J ^ Raibie, 1937) who in- 

;cious whispering (Kennedy, 193 ). . Qf (j^e 17 


scious whispering (Kenneay, not. Of the 1/ 

perimenter knew the correct ° ^ f^om a chance distribution of 

subjects, only 6 showed a large iswcp fewer errors on trials in 

errors. However, all 6 of these su the lighter or heavier. At least 

which theexperimenter knew which weight was thehg 
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Greenblatt (1964) describes a patient suffering from advanced cancer 
who was admitted to the hospital virtually dying He had been exposed to 
the information that Krebiozen might be a wonder drug, and some was 
administered to him His improvement was dramatic and he was discharged 
to his home for several months He was then exposed to the information 
that Krebiozen was probably ineffective He relapsed and was readmitted to 
the hospital There, his faith in Krebiozen was restored, though the injec- 
tions he received were of saline solution rather than Krebiozen Once again 
he was sufficiently improved to be discharged Finally he was exposed to the 
information that the American Medical Association denied completely the 
value of Krebiozen The patient then lost all hope and was readmitted to the 
hospital, this time for the last time He died within 48 hours Such an 
anecdote might not be worth the telling were it not for the fact that effects 
almost as dramatic have been reported in more formal research reports 
on the effects of placebo in clinical practice Excellent reviews are available 
of this literature (eg, Honigfeld, 1964, Shapiro, 1960, Shapiro, 1964, 
Shapiro, 1965), which show that it is not at all unusual to find placebo 
effects more powerful than the actual chemical effects of drugs whose 
pharmacological action is fairly well understood (eg, Lverlv, Ross, Krug- 
man,& Clyde, 1964) ^ B’ ^ b 


In his comprehensive paper, Shapiro (1960) cites the wise clinician’s 
a monition You should treat as many patients as possible with the new 
P®*" ‘0 heal” (p 114) The wisdom of this 
cliTiK'n appreciation of the therapeutic role of the 

ex^rtJl '“ V" This faith is, of course, the 

o?r.re^Z“", The clinician’s expectancy about the efficacy 

witharesuhm commumcated to the patient 

with a resulting eBeet on his psychobiological functioning 


EXPECTANCY EFFECTS IN 

experimental psychology 


hsh thf Validity or'thTRorKhach''tech''’*‘ ®stab- 

Levy and Orr tlO'iOWnt j technique of personality assessment 

low?ng“"dl°ensions (\T rrdemm 

author, (2) whether the study was *51^ r"'*'"'''*""”'' ‘he 

validity, and (3) whether the outcoml of ,h° 

favorable to the hypothesis of f®'’°f‘>hle or un- 

academicians, morer msL m forbid 
lively more favorable lo construct validation anH^l’ 

xahdation On the basis of their findings these worSrs'ered for m" 
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exchange of letters in Science, Zirkle (1958) and Razran (1959), in dis- 
cussing Pavlov’s attitude toward the concept of the inheritance of acquired 
characteristics, give credence to a statement by Gruenberg (1929, p 327) 
“In an informal statement made at the time of the Thirteenth International 
Physiological Congress, Boston, August, 1929, Pavlov explained that in 
checking up these experiments, it was found that the apparent improve- 
ment in the ability to learn, on the part of successive generations of mice, 
was really due to an improvement m the ability to teach, on the part of the 
experimenter' And so this ’proof of the transmission of modifications drops 

out of the picture, at least for the present ” 

Probably the best-known and most instructive case of experimenter 

expectancy eLcts is that of Clever Hans (Pfungst, 1911) ^ 

reLmbered, was the horse of Mr von Osten a 

teacher By means of tapping h.s foot, Hans was ab e to add mul ^ 

ply, and divide Hans could spell, read, and solve 

ILony To be sure, there were other clever ammals ^ 

Pfungst tells about them There was “Rosa,” ‘"e ">7 

performed similar feats in vaudeville, and there was the dog o Ut^h^ d 

rtie reading pig of Virginia All these other 3^ 

trained performers who were, '"^'^om L ammd’s talent, nor 

Mr von Osten, however, did not profit irom ^ jj 

did It seem at all likely that he was attempting ^/J^^aon 

swore he did not cue the animal, and he permi e P ^ famous 

and test the horse even without his being present ^ng tos^amo 
colleague, Stumpf, undertook a program « was that if 

the secret of Hans’ talents ^ clever at all Similarly, 

the horse could not see the questioner, to the question, Hans 

If the questioner did not Pfungst’s ques- 

could not answer it either Still, Ha" pfungst reasoned 

tions as long as the investigator was p ^ when to begin 

that the questioner might m some « X ^ J .ndination of the head of the 
and when to stop tapping his hoof A observed He tried then to in- 

questioner would start Hans tapping, g discovered that this was 

Sine his head forward without - "raightened up, Hans 

sufficient to start Hans’ tapping As P tapping by using 

would stop tapping ‘ bat fven the raising of 

very slight upward motions of the questioner’s nostrils 

his eyebrows was sufficient Even t 

was a cue for Hans to stop tapping horse would tap faster 

When a questioner bent 7bnlhant That is, when a large 

This added to the reputation of Hans a 

number of taps was the correct respo ’ then he began to 

rapidly until he approached the region o . forward more when 

slowdown It was found that questioners typiea y 
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for those 6 subjects who were more affected by the experimenter’s knowl- 
edge of the correct response, the authors’ conclusion seems justified 
(p — 03) As an alternative to the interpretation of these results as ESP 
phenomena, they suggested the possibility of some form of auditory cue 
transmission to subjects 

Among the most recent relevant studies in the area of ESP are those 
by Schmeidler and McConnell (1958) These workers found that subjects 
who believed ESP possible (“sheep”) performed better at ESP tasks than 
subjects not believing ESP possible (“goats”) These workers suggested that 
an experimenter, by his presentation, might affect subjects’ self-classifica- 
tion, thereby increasing or decreasing the likelihood of successful ESP per- 
formance Similarly, Anderson and White (1958) found that teachers’ 
and students’ attitudes toward each other might influence performance in 
classroom ESP experiments The mechanism operating here might also have 
been one of certain teachers’ expectancies being communicated to the 
children whose self-classification as sheep or goats might thereby be af- 
fected The role of the experimenter in the results of ESP research has been 
discussed recently by Crumbaugh (1959), and much earlier by Kennedy 
(1939), as a source of evidence against the existence of the phenomenon 
No brief is filed here for or against ESP, but if, in carefully done experi- 
ments, certain types of experimenters obtain certain types of ESP per- 
fonnances m a predictable manner, as suggested by the studies cited, 
further evidence for experimenter expectancy effects will have been adduced 


hmchll.r psychological research— memory— Eb- 

own respn h h attention to expenmenter expectancy effects In his 

affected the H expectancy of what data he would obtain 

that the tt e su sequently did obtain He pointed out, furthermore, 
cicnt to contrnrth" ^''towlcdge of this expectancy effect was not suffi- 
crscd fuXr n long neglected, will be dis- 

Another nnis hi question of early data returns is taken up 

Stc\ensn96n case and another classic, has been described by 
over the results of mv'h controversy between Fechner and Plateau 

turc of the functin expenmenis designed to determine the na- 

Delbocuf earned out expenments^frpf”, k 
maung the Fechner, an pnd.ction o7a Ion r’ c'"'""'’ f’’/™’"' 

these results wh.ch mavL interprctabk a? " puzzled over 

Either by .mphatly expecting tte Fwinenn 

guard against an untt-Lhnenan biL 7Xo7r”'\°' uttempt.ng to 
outcome of his studies ' “uy huve influenced the 

It Mould appear that Pavlov was awnrp . I, 

pectaney of the expenmenter eould afleetXres^^Tetp:^^!'^:.: 
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There is a more recent example of possible expectancy effects, and this 
time the subjects were humans The expenment dealt with the Freudian 
defense mechanism of projection (Rosenthal, 1956, Rosenthal, 1958) A 
total of 108 subjects was composed of 36 college men, 36 college women, 
and 36 hospitalized patients with paranoid symptomatology Each of these 
three groups was further divided into three subgroups receiving success, 
failure! or neutral experience on a task structured as and simulaUng a 
standardized test of intelligence Before the subjects’ experimental treat- 
ment conditions were imposed, they were asked to ram the degree of success 
or fadure of persons pictured in photographs Immediately after the experi- 
mental mampulation, subjects were asked to rate an equivalent set of 
photos on them degree of success or failure The dependent vunabk ^ 
Lgmtude of the difference scores from pre- to 

graphs It was hypothesized that the “success” “eatment cond tion wouU 
lead to greater subsequent perception of other peop e s ’ „ 

the “failure” treatment condition would lead to greater ^ “c 
tion of other people’s failure as measured by the 

An analvsis (which was essentiaUy unnecessary to the mmn puipose 
of the study) was performed '"‘'•ch compared the mean 

three expenmental treatment "ll 0 The pre-rating mean of the 

success, -1 5, neutral, -0 9, fa'’"®’ , ^ qj) than the other 

success treatment group was significantly lower tp ; 
means In terms of the hypothesis under test, “ !ve“.f 
group would tend to lead to ^^ 00 ^ WUhom the 

the post-ratings were identical for al obtaining 

investigator’s awareness, the cards ha emphasized that 

results confirming the had been identical, verbaPm, 

the success and failure groups mstru rinstructions to the neutral 

dunng the pre-rating phase of task, 

group differed only in that no mentio 

since none was administered to this group ) subiect which expen- 

The investigator, however, 7 " 

mental treatment the subject would s q bv tone, or manner, or 

plication IS that in some subtle manner, P although formally treat- 

gestures, or general atmosphere, ‘'’® “JdenUcal way, influenced the success 
mg the success and failure groups in increase the experimenter’s 

subjects to make lower initial ratings I 956 , p%4) As a 

probability of venfying his hypot “'V^ss subiects had been differently 
further check on the suspicion tha -gs of photos was analyzed 

treated, the conservatism extremeness o p follow success, 3 9, 

The mean extremeness of-rating score rated photos significantly 

neutral, 4 4, failure, 4 4 *;^77&eatmen? Whatever 

(p = 001) less extremely than did ttie 
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the answer was a long one, gradually straightening up as Hans got closer 
to the correct number 

For some experiments, Pfungst discovered that auditory cues func- 
tioned additively with visual cues When the experimenter was silent, Hans 
was able to respond correctly 31 percent of the time in picking one of many 
placards with different words written on it, or cloths of different colors 
When auditory cues were added, Hans responded correctly 56 percent of 
the time 

Pfungst himself then played the part of Hans, tapping out responses 
to questions with his hand Of 25 questioners, 23 unwittingly cued Pfungst 
as to when to stop tapping in order to give a correct response None of the 
questioners (males and females of all ages and occupations) knew the intent 
of the experiment When errors occurred, they were usually only a single 
tap from being correct The subjects of this study, including an experienced 
psychologist, were unable to discover that they were unintentionally emitting 
cues 

Hans’ amazing talents, talents rapidly acquired too by Pfungst, serve 
to illustrate further the power of the self-fulfilling prophecy Hans’ ques- 
tioners, even skeptical ones, expiected Hans to give the correct answers 
to their queries Their expectation was reflected in their unwitting signal to 
Hans that the time had come for him to stop his tapping The signal cued 
Hans to stop, and the questioner’s expectation became the reason for Hans’ 
being, once again, correct 

Not all of Hans’ questioners were equally good at fulfilling their 
prophecies Even when the subject is a horse, apparently, the attributes of 
t e experimenter make a considerable difference in determining the response 
0 a su ject On the basis of his studies, Pfungst was able to summarize the 
c aracteristics of those of Hans’ questioners who were more successful in 
their covert and unwitting communication with the horse What seemed 


1 

2 

3 

4 

5 


generally =>nd “tact” in dealing with animals 

That he have an air of quiet authority 

Tjiathe concentrate on the correct answer, both expecting and wishing 


facility for motor discharge or be gesturally inclined 

1 hat he be in relative good health ° t, j 


of Clever of uncovering the nature 

h^e whM had been misled by “looking for, in 

of lust sueMolv “"S"' ■" ” Additional examples 

mbe ounH el 7 '"rn '"u"® references are 

to be found elsewhere (Rosenthal, 1964b, Rosenthal 1965a) 
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the manner m which the experimenter differentially treated those subjects 
he knew were destined for the success condition, it seemed to affect not only 
their mean level of rating but their style of rating as well 

It was these puzzling and disconcerting results that led to the expen- 
ments to be described m Part II 
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The evidence presented up to this point that the 
eitpenmenter may in part determine the results o is 
at least somewhat equivocal Some of the evidence as ee expen- 

has required the untenable assumption that the “pectan y 
menter, and not some correlated vanable, had e o , before- 
That IS the case in any study in which the data “ ^“^t 

hand the data he will obtain and then “"’.eVceZn 

direction In such cases it could be that expenm jg 

lands of data differ in other ^ .nflutnce the subjects’ 

these attributes, rather than /' of the expenmenter’s 

response The most clear-cut evidence which experimenters 

expectancy, therefore, '°^Q™™^®SeTexamined, that by Stanton 
ate given different expectancies Of t requirement of the expen- 

and Baker (1942) comes ‘ does require, however, the 
mental induction of an the^subjects to answer correctly 

assumption that experimenters will p rpomred to interpret the 

the Items being presented The ' ,ancy effects The studies to 

case of Clever Hans as an expenment P j (gs,s of the hypothesis 
be described now seem to be fairly 'r ' larch resuUs 

of the effects of the experimenter’s expectancy on h.s research 


fHE PERSON PERCEPTION TASK 


E PERSOIN * 

tn rpfer often to the person 
In earlier chapters there has been ^ „ should be described 

erception task The details of the 3 cm to 5 X 6 cm 

ufty-seven photographs of faces ranging m^^ mounted on 3 X 5 m white 

/ere cut from a weekly news maga 
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THE FmST EXPERIMENT = 

Ten of the eleven students in a class in undergraduate experimental 
psychology served as experimenters All were psychology majors, and three 
of them were first-year graduate students in psychology All but two of the 
expenmenters were males Subjects were 206 students enrolled m a course 
m introductory psychology (92 males and 114 females) Because subjects 
were given class credit for participating in the expenment, most of the 
class volunteered, thus reducing the selective effect of using volunteer sub- 
jects (Rosenthal, 196Sb) Each expenmenter contacted from 18 to 24 

tL experimenters’ task was structured as a laboratory exercise to 
see whether they could replicate “weU-estabhshed” expenmental findings 
as “students in physics labs are expected to do” Expenmenters were to 
to discuss their project with no one and to say nothing to ‘he>r jubjems 
other than what was m the InstrucUons ,o Sub, cats A^l 
paid a dollar an hour except that if they did a goo jo y . 

paid double two dollars an hour All ten expenmenters recew d 
instructions except that five expenmenters 'x'cre o exoen- 

would average a -1-5 rating on the ten neutral photos J^e other expen 
menters were told that their subjects would average a .j,.? one croup 
only difference between the two groups of “FHotonters ^a^ hm one ^oup 

minus mark written in front of the 5 P . nhotos The 

training, each of them also rated the standardized set of ten photos The 

exact instructions to experimenters were as o ows 

, vnii have been asked to participate in a 
Instructions to „ You may have seen this project 

research project developing a test ^ '“P reason for your participa 

written up in the campus newspaper Th duplicating experimental 

tion in this project— namely, to pve y p experiments to see 

results In physics labs, for example, you -stabhsted You will now be 

If your findings agree with ‘h°sc f photographs The 
asked to tun a senes of Ss and obta explanatory DO 

experimental procedure has been typ . jpyoNE until your instructor tells 

NOT DISCUSS THIS PROJECT WITH an xuii'i 

you that you may your time If your resets 

You will be paid at the rate of $ P instead of $1 00 The 

come out properly-as expected-you will b= P““l *^ng 
Ss you are running should average about a t lo them except hello 

Just read the instructions nnythmg to an S other than what 

and goodbye If for any reason you sn j 

, have been reported earlier (Rosenlhal 4 

2 This study and the first repb^bon h 
Fode, 1961 Rosenthal & Fode 1963b; 
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cards These were presented to 70 male and 34 female students, enrolled in 
an introductory psychology class at the Umversity of North Dakota Sub- 
jects were instructed to rate each photo on a rating scale of success or 
failure The scale, shown in Figure 1, ran from —10, extreme failure, to 
4-10, extreme success, with intermediate labeled points Each subject was 
seen individually by the author who read to each the following instructions 


Figure 1 

The Empathy Test Rating Scale 

Extreme Moderate Mild Mild Moderate Extreme 

Failure Failure Failure Success Success Success 

-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 +l +2 +3 -1-4 4-5 +6 -1-7 -f 8 +9 4-10 


InstructioTis to Subjects I am going to read you some instructions I am 
not permitted to say anything which is not m the instructions nor can I answer 
any questions about this experiment OK’ 

We are in the process of developing a test of empathy This test is designed 
to show how well a person is able to put himself into someone else’s place I 
will show you a senes of photographs For each one 1 want you to judge whether 
the person pictured has been experiencing success or failure To help you make 
more exact judgments you are to use this rating scale As you can see the 
scale runs from —10 to -f 10 A rating of —10 means that you judge the person 
to have experienced extreme failure A rating of -f-lO means that you judge 
the person to have experienced extreme success A rating of —1 means that 
you ]u ^ the person to have experienced mild failure, while a rating of -f 1 
means t at you judge the person to have experienced mild success You are 
to rate each photo as accurately as you can Just tell me the rating you assign to 
^ Here is the first photo (No further explanation may he 

given, although all or part of the instructions may be repeated ) 


From the onginal 57 photos, 10 were selected for presentation to male 
subjects and 10 were selected for presentation to female subjects All 20 
p otos were rated on the average as neither successful nor unsuccessful, and 
or each the mean rating evoked fell between +1 and -1 The d.stnbu- 
bons of rattngs evoked by each of the photos were also symmetrical The 10 

femnte “f a'n>ul. for male subjects and the 10 for 

female subjects were rated on the average as exactly zero > 

cn thrvalXv" of the expectancy effects does not depend 

to d«em:iri'h’'e chU^enmef 

panson or centrot Proup i„ any of the exp^i^cn^^d^^Lrin'ZTok “ 
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dealing with the communication of the experimenter’s expectancy. Here, 
only those portions of the study are reported that served the replication 
function. 

Twelve of the 26 male students enrolled in an advanced undergraduate 
course in industrial psychology were randomly assigned to serve as expn- 
menters. In this sample of experimenters, few were psychology majors; 
most were majoring in engineering sciences. Subjects were 8 stu ents en 
rolled in a course in introductory psychology (50 males and 36 females). 
These subjects were also given class credit for participating in the expen- 

ment. Each experimenter contacted from 4 to 14 subjects. 

The procedure of this experiment was just as in the preceding sm y 
with the exception that experimenters did not handle the photos^ Instead 
eaeh set of tL photos was mounted on cardboard and ^ 

subjects could call out their ratings of each photo to t eir 

was thought that less handling of the photos might se^e ore There 

of experimenters’ expectancies on the data obtained f™”’, f 

were two reasons for this thinking. First, if the 

each stimulus photo, the subject would have 

field of vision much less often and the number of cues observed by 

TABLE 9-2 


Experimenters' Expectancy and Subjects' Mean Rat- 
ings! Replication 


expectancy 


+5 

+3.03 

+2.76 

+2.59 

+2.09 

+2.06 

+ 1.10 


-5 

+ 1.00 
+0.91 
+0.75 
+0.46 
+0.26 
-0.49 


Means 


+2.27 


+0.48 


subject should be reduced. That had been ^^g^uspicion that the 

Hans. The second reason, related to ® j^gld the stimulus photo 

movements of the hand in which I e exire thinking about the one 

might serve a cueing function, (inis ,he variables 

chLge in procedure, but the change itself was 
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,s wntten m your instructions, please write down the exact words you used and 
the situation which forced you to say them 
GOOD LUCK! 

The results of this expenment are shown in Table 9-1 Each entry repre- 
sents the mean photo rating obtained by one expenmenter from all his sub- 
jects The difference between the mean ratings obtained by expenmenters 
expechng success (-|-5) ratings and those expecting fadure ( 5) ratings 

was significant at the 007 level (one-tailed p, f = 3 20, df = S) All ex- 

TABLE 9-1 


Experimenters' Expectancy and Their Subjects' Mean 
Ratings of Success 


EXPECTANCY 


+5 -5 

+ 66 +18 

+ 45 +17 

+ 35 +04 

+ 31 - 37 

+ 25 - 42 

Means +40 _ 08 


penmcnters expechng success ratings obtained higher raUngs than did any 
expenmenter expecting failure rahngs Such nonoverlapping of distnbutions 
occurs only rarely in behavioral research and has a prohahility of 004 (one- 
tailcd, for Ni = Ns = 5) The mean ratings obtained by the two female 
experimenters, one in each treatment condition, did not differ from the 
mean ratings obtained by the male expenmenters of their respective expen- 
mental conditions The grades earned by all expenmenters in their expen- 
mcntal psychology course were not related to either the mean photo ratings 
obtained from subjects or the magnitude of the biasing phenomenon 


the first REPLICATION 

magnitude of the expectancy edects obtained was not readily 
bchctablc, and a replication was performed by Kermit Fode (1960) There 
were other reasons for this study, which will be discussed in the chapter 
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been selected for their charactenstic level of anxiety defined by the Taylor 
Scale of Manifest Anxiety The eight expemnenters whose results will be 
descnbed were aU medium anxious Half were randomly assigned to a group 
led to expect success (+5) ratings, and half were assigned to a group led to 
expect failure ( — 5) ratings 

The results of this second rephcation are shown m Table 9-3 Once 
agam, experimenters expecting ratmgs of people as more successful ob- 
tained ratings of higher success than did expenmenters expectmg ratmgs of 
people as failures, this time with an associated p value of 005 (one-tmled, 
/ = 3 96, df = 6) Once again, too, the distnbuhons did not overlap 
Every experimenter expecting positive ratmgs obtained positive ratings, 
and every expenmenter expectmg negative ratings obtained negative ratmgs 
Table 9-4 gives a summary of the magmtude of expectancy effects obtamed 
m each of the three expenments descnbed Employing Stouffer’s method 
suggested by Mosteller and Bush (1954) gave a combmed probabihty for 
the three expenments of one in about two milhon 


TABLE 9-4 


Summary of Three Basic Replicates 


EXPECTANCY 


Experiment 

+5 

-5 

Difference 

t 

df 

P 

1 

+0 40 

-0 08 

+0 48 

3 20 

8 

007 

11 

+2 27 

+0 48 

+1 79 

4 99 

10 

0003 

III 

+0 69 

-0 62 

+1 31 

3 96 

6 

005 

Means 

+1.12 

-0 07 

+I 19 





SOME DISCUSSION 

It seems reasonable to conclude from these data that the results of 
an expenment may be determined at least in part by the expectations of the 
expenmenter Since the expenmenters had ail read from the identical 
instructions, some more subtle aspects of their behavior toward their 
subjects must have served to communicate their expectations to their sub- 
jects From expenmental procedures and from more naturalisUc observation 
of expenmenters interacting with their subjects, some things haie been 
learned about the communication of expectancies What is Xnoivn of this 
communication will be discussed in a subsequent chapter We may note 
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investigated formally Rather, the change was required so that the two 
replication groups would not differ from other experimental groups of the 
expermient in procedure ) 

The results of the replication are shown in Table 9-2 As in the 
onginal experiment, half the experimenters had been led to expect raUngs 
of success (+5) and half had been led to expect ratings of failure (—5) 
The difference between these two groups of experimenters in the responses 
they obtained from their subjects was again significant, this time at the 
0003 level (one-tailed p. t = 4 99, df = 10) Once again, all expen- 
menters expecting ratings of success obtained ratings of the photos as 
more successful than did any of the experimenters expecting failure ratings 

THE SECOND REPLICATION 

There is one more experiment by Fode (1965) which is sufficiently 
similar to the two described already to be usefully regarded as another 
replication Later, in the chapter dealing with experimenter characteristics 
associated with greater and lesser expectancy effects, other aspects of that 
study will be considered Here, we consider only the two most relevant 
groups employed by Fode 

There were eight experimenters, all advanced undergraduate students 
in industrial psychology, the same course from which the expenmenters of 
the first replication were drawn, but, of course, in a different year The 90 
subjects were all enrolled in an introductory psychology course (55 males 
and 35 females) Each experimenter contacted from 9 to 13 subjects 
The procedure was as in the onginal expenment The major difference 
between this and the original expenment was that experimenters had 


TABLE 9-3 


Experimenters' Expectancy and Subjects' Mean Rat- 
ings; Second Replication 


EXPECTANCY 


+5 

+1 51 
+0 64 
+0 47 
+0 13 

+0 69 


-5 

-0 31 
-0 49 
-0 65 
-1 02 

-0 62 


Weons 
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Finally, from the filmed and direct observations of other expenments 
in progress, it could be determined that experimenters do record the 
response as given by the subject In the filmed studies, not all responses 
could be checked, however, because there were places where the sound 
track was too poor to be sure what response the subject had given 

In the expenments described, the expenmenters were offered extra pay 
for “a good job ” Perhaps the expectancy effect depends on such extrinsic 
mcentives On the basis of just these expenments no answer is pos^ble 
Later, however, there will be experiments that did not offer such additiona 
incentives to experimenters to obtain biased responses In fact, we sh^ 
encounter evidence suggesting that with increased incentive the effects of 
expectancy are reduced or even thrown into a reversal of direction 
^ Questions of the generality of expectancy effects have been d'scussed 
in the preceding chapter In Part III there will be a 
of the generality of expectancy effects based on the research program 

designed specifically to neutal 

ful of cues from the expenmenter to guide them hem rating K the 
photos could “be” anything, successful or unsuccessful, then even imnor 
Les should make it easy to influence the subjects 

s, Ltr.;: s. .'.Uh.- s««p 

subjects, IS not, therefore, a ^3^ 3 source of ecological in- 

In the three expenmen s es expenmenters con- 

vahdity which should be discussed T expectancy Subjects were 

tacted subjects under only a single nerceivers In “real” 

research it is more common for control groups The question 

subjects of both the expermenta effects ^occur also when the 

must therefore be raised whether e p y diffenng expectancies 

same experimenter contacts subjects f3, 33,5 „hich sheds 

An expenment that is similar to employed three male 

light on this matter is one 3^:17 msk ^ 64 fLale subjects 

expenmenters to ^ jg^to 23 subjects For half these 

Each of the expenmenters 5,tn,o stings of the success 

subjects the “P- 

of Others (4-5), and for half th y , ^^ch “type” of subject was 

The order m which expenmenters raungs obtained by each 

random Table 9-5 shows the mean photo j^ ’ — 

Mnerimenters attention under what con 

often these errors to the expenmente 

ditions, and by what type of subject 
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in passing, however, that of the studies described just now, one (II of Table 
9-4) in which the experimenters were less often in the subjects’ field of 
vision, and m which experimenters did not handle the stimulus photos, 
did not show a decrement in the biasing effect of the experimenter s expect- 
ancy. Surprisingly, that study was the one to show the greatest magnitude 
of biasing effect. It may at least be concluded that the communication of 
the experimenter’s expectancy does not depend either on his handling of 
the stimulus materials or on his being within the subject’s constant view. 
From this alone, it seems that the communication processes involved are 
not quite like those discovered by Pfungst to apply to Clever Hans. Hans, 
It wiU be recalled, did suffer a loss of unintended communication when he 
lost visual contact with his experimenter.® 

In the first few chapters of this book there was a discussion of a 
number of effects of experimenters which did not affect their subjects’ 
responses but which could affect the results of their research. It should 
be considered whether errors of observation or interpretation, or even 
intentional errors, could have accounted for the findings reported. Errors 
of observation and of interpretation are hard to discriminate in these experi- 
ments The subject calls out a number and the experimenter records it as 
he hears it We do know that errors of recording occur and that they tend 
to occur in the direction of the experimenter’s expectancy. But the evidence 
presented in earker portions of this book suggests that the magnitude of 
such errors is most often trivial Intentional errors could have occurred, 
but they, too, are unlikely to have led to three sets of nonoverlapping 
distnbutions 

The hypotheses of recording errors and of intentional errors seem 
further weakened by the microgeography of the experimental interactions. 
The subjects sat m such relation to the experimenter that they could see 
what the experimenter recorded on his data sheet. For either recording 
errors or intentional errors, therefore, the subject was in a position to 
correct the experimenter’s entry* 


II All'^ne^rimpnw^^^f possibly due to the different conditions of experiment 

L LardTes? ^ of photos as more success- 

-xp'nmenters of the other two 
havine le<is tn Hr. H.ir.nr. ,u ^ possible that experimenters of study H* 

as less imoorfant nr nf^i mteraction with the subjects, were perceived by them 
expenmenfer^ Im, .n?'" dealing with the effects of the 

status experimenters did tend^tjf^hf Presented which suggested that lower 
successful people obtain ratings of these photos as being of more 

that oCM°ion°any'sub,ects d^correTthOT'exM ““ ot te 

AnTmet'a" .r'xpLTme^ t m .S'* apprav“ 
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expectancy effects of a single investigator, the author In some of the early 
studies in the research program such eSects of the pnncipal investigator 
cannot be ruled out Thus there were studies m which the author ushered 
subjects into the experimenters’ rooms without being bhnd to the expen- 
menters’ expectancies Knowing that a given subject was destined for a 
“success”-expecting experimenter may have led the author to treat these 
subjects differently, in such a way as to affect then: photo ratings Even 
when the walk with the subject from waiting room to laboratory is short, 
such effects cannot be ruled out Later studies in the research program 
eliminated these potential effects The details of the safeguards against the 
principal mvestigator’s expectancy will be given in later chapters For now 
It should be mentioned that in many of the studies conducted the investi- 
gators did not know which experimenters had what expectancies untd the 
expenment was completely finished 

A pomt to be developed later is that ten experiments performed m 
a single laboratory may be worth less than the same ten expenmente 
conducted in ten different laboratories Most of the expenments reported 
m this book were conducted in a single “laboratory,” or at least ‘"™lved one 
common investigator For this reason it is especially imjio an 
other laboratones for evidence to support or to infirm the ''JT^sis of 
the expectancy effect of the psychological expenmenter Some such evidence 

was reported in the last chapter, and a few more Kari 

In a demonstration employing the same task descnbed her^ Karl 
Weick had two experimenters conduct the person percephon 
front of his class in expenmental social psychology One ^nmenter 
was led to expect success ratings from his five subjects 
to expect failure ratings from his five su jec s , nf exoectan 

in more detail in the chapter dealing with the 

cies Bnefly the expenmenter expecting positive 7,^1, 1^01- 

ratmg of +l 18, whereas the expenmenter expecting negative ra ..^g ob 
tamed a mean rating of -0 50 The difference was significant 

'"'‘’There'^fa^ery recent experiment by Mashng (1965) in which he gave 
1 nere is a very rccc. g „,Hiiate students m a “new method of 
“special training to a group j examiners were led to believe 

leammg the Rorschach P™«‘‘n"= * relatively greater proportion of 

that expenenced examiners obtained -TTminers were led to 

human percepts in the ink ^ ^relatively more animal pcr- 

believe that expenenced — " "„"Lt intiactions were tape- 

cepts from their subjec s All the e expenenced examiners 

recorded Examiners led to belie „u,„,ned a ratio of I 8 animal 

obtained relatively more human P" believe that obtaining 

percepts to each human P'^ ^ „„ animal to-human percept 

rar‘‘!,fT;‘’(;r 04 T If there examiners also expected to obtain the 



152 


Studies of Experimenter Expectancy Effects 


TABLE 9-5 


Experimenters' Expectancy and Subjects' Mean Rat- 
ings- Alternating Expectancies 



EXPECTANCY 


Experimenter 

+5 

-5 

Difference 

A 

- 13 

-.67 

-I-.54 

B 

- 51 

- 72 

-f21 

C 

- 96 

-1 59 

+ 63 

Meons 

- 53 

-.99 

•1-.46 


experimenter under each type of expectancy All three of the expenmenters 
obtained higher ratings of success when expecting such ratings than when not 
expecting such ratings (p = 04, one-tailed, ( = 3 61, d/ = 2) The mean 
magmtude of the expectancy effect was -f 46, which was very close to 
the value of +48 obtained in the original expenment (I of Table 9-4) 
In Laszlo’s study there was also no extra pay offered to expenmenters for 
obtmnmg the expected data Apparently neither the extra incentive offered 
or good data nor the holding of only a single expectancy for all subjects 
T M experiments described earher It 

Should be noted, however, that in the Laszlo study, the distnbutions of 
mean p oto ratings obtained under the two conditions of expectancy 
nf results are less dramatic than those 

of ihf- studies Whether this was due to some dampening effect 

The I a varying for the experimenters cannot be determined 

ascnbed h ^ ■" ‘■elf the time a higher status was 

Smncf JTT”'"’ status This procedural 

~enwf : weakened effect of the 

S cWacten? “ '"'’sequent chapter dealing with the per- 

addihonal eviH ° successful unintenUonal mfluencers, some 

~ rs'^ “'eo ehows that the effects of ex- 

Lero'^as^n^ircrr^^^^^ “P™ 

expect’ncvTffemsT'’ “ 'he extent to which the 

eSSe s bi tfT "e' ‘he expectancy of the 

the eaTe ^ would “Pee'eney of the author It thm were entirely 

of the exim • 'he evidence tor the effects 

the number of r ^^P^ctancy It would, however, reduce considerably 

Lundr™ to oL 

e, then, a longitudinal case study of the 
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this learning curve at least suggests that such reinforcement was a possibility. 
Alternatively, it might have been the subject who reinforced the experi- 
menter’s unintentional communication behavior. This possibility mil be 
discussed in more detail in the chapter dealing with the communication of 
expectancy effects. 

Troffer and Tart (1964) reported on some relevant expenmenter 
effects obtained from a sample of eight experimenters. The sample was 
particularly interesting in that these experimenters were fully aware of the 
problem of “experimenter bias.” The experiment caUed for subjects to be 
tested on the Stanford Hypnotic Susceptibility Scale (Weitzenhoffer & Hil- 
gard 1962). Half the time the experimenters adimnistered the scde after 
an hypnotic induction procedure. Half the time they administered the scale 
without having attempted any hypnotie induction. All expenmenter- 
subjeet interactions were tape-recorded, and the experimenters ^ 

theL recordings were being made. The very ^t item of 
tests was found to have been read differently m subjects °° 

whether the experimenter had or had not gone through the ■”‘5“ 
cedure. Judges Ustening to the tapes rated experimenters as speatang in 
a Ire related, somnoLt, soUcitous, and c°-need tone when they had 
gone through the hypnotic procedure before testing their subjects. What 

II tI;iIcue^udgesLuld correctly assess whether.^^^^ 

had or hid not carried out the induction procedure f 

dffferentime bluer ton chance,^! remaining six judges 

a chance level was the only one who felt that tne expenm 

up anything. nmvide two interpretations, either or both 

The authors of this rep p results The first interpretation 

of which might have h an induction procedure 

suggests that the Ind Lkes him a more effective 

essentially warms up the expenm relevant to our immediate 

hypnotist. The second 

concern, suggests that expenmentere Pp such better perform- 

condition involving hypnotic indu ?^S 

ance led them to put more into S experimenters favored 

subjects. It should be noted that ““ f “nd ol’expectancy.’’ 

the first, or hvarm-up, interpre a ^ 

interpretation. So exceUent evidence that even seasoned 

of expectancy effects, do ha identically, were unable to 

experimenters, cannoned to treat J , ,cd their subjects 

do so. Instead, these “b.as-w se ,hc con- 

as they would have to be treated to increase 
firmation of the hypothesis. 
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Smallest in sample size, but perhaps the most “lifelike,” of the 
relevant studies from other laboratones is a study by Rosenhan (1964) 
There viill be occasion to cite his work again when the topic of expectancy 
control groups is treated in Part III Bnefly, Rosenhan had established 
through corrclaljonal research a certain complex pattern of relationships 
between hj'pnosis and vanous types of conformity behavior Then he and 
a research assistant set out independently to replicate these findings Before 
beginning the replication, Rosenhan showed the assistant the pattern of 
correlations he had ongmally obtained, only he reversed the sign of every 
correlation coefficient Thus the larger positive correlations became the 
larger negau\c correlations, the negatives became the positives The 
data the assistant subsequently obtained from her subjects were signifi- 
cantly different from those obtained by Rosenhan in his own replication In 
most cases, he reports, the correlations obtained by the assistant were 
opposite in sign to those obtained by him, but were, of course, in line with 
the corrclauons she had been led to expect 

In spite of identically programmed procedures, two “real” expen- 
mcntcrs obtained significantly opposite data, to each came what was ex- 
pected Rosenhan points out that the two experimenters differed in more 
ways than just m the nature of the expectancy held by each There were 
differences m sex, age, status, and experience, and any or all of these could 
have contributed to the obtained reversals Rosenhan’s conclusion, however, 
was that compared to the possible effects of these correlated variables, 
“It seems far more likely that the differences obtained in the hypnosis- 
conformity study were a function of the different expectations and hypothe- 
ses held by the cxpcnmcntcrs” (p 27) * 

The basic experiments designed to test the hypothesis of the effect of 
the experimenters expectancy require one additional comment That has 
to do with the fact that in every case deception was involved There was 
deception of the subjects in their being told that their task was a test of 
crnpalh) There was deception of the experimenters in their not being 
told that It was their behavior which was of the greatest interest, and in 
their being given false information about the subjects in order that expcct- 

nncies coulcl be intiiieeil ^ 
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If it and many psychological techniques are to be used at all, the purpose 
must be disguised, and that, of course, is deception. The problem will be dis- 
cussed again in Part III. For now the faet of deception must be accepted, 
and the hope must be that the knowledge acquired through this necessary 
deception is worth the price of having deceived. 
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Smallest in sample size, but perhaps the most “hfelike,” of the 
relevant studies from other laboratories is a study by Rosenhan (1964) 
There will be occasion to cite his work again when the topic of expectancy 
control groups is treated in Part III Briefly, Rosenhan had estabhshed 
through correlational research a certain complex pattern of relationships 
between hypnosis and vanous types of conformity behavior Then he and 
a research assistant set out independently to replicate these findings Before 
beginning the replication, Rosenhan showed the assistant the pattern of 
correlations he had originally obtained, only he reversed the sign of every 
correlation coefficient Thus the larger positive correlations became the 
larger negative correlations, the negatives became the positives The 
data the assistant subsequently obtained from her subjects were sigmfi- 
cantly different from those obtained by Rosenhan m his own replication In 
most cases, he reports, the correlations obtained by the assistant were 
opposite in sign to those obtained by him, but were, of course, m line with 
the correlations she had been led to expect 

In spite of identically programmed procedures, two “real” experi- 
menters obtained significantly opposite data, to each came what was ex- 
pected Rosenhan points out that (he two experimenters differed in more 
ways than just m the nature of the expectancy held by each There were 
differences in sex, age, status, and expenence, and any or all of these could 
have contnbuted to the obtained reversals Rosenhan’s conclusion, however, 
was that compared to the possible effects of these correlated variables, 
t seems far more likely that the differences obtained in the hypnosis- 
con omity study were a function of the different expectations and hypothe- 
ses held by the expenmenters” (p 27) 5 

The basic experiments designed to test the hypothesis of the effect of 
require one additional comment That has 
0 with the fact that m every case deception was involved There was 
ZThT ml *’'■"£ ‘“‘ri ‘hut their task was a test of 

told th-Jt deception of the experimenters m their not being 

thpir behavior which was of the greatest interest, and in 

anciescoum®bemdn«d"'°""“''°" 

does nm (Ivm ^ "rcessary commonplace in psychological research One 
does not give subjects the Cnhforma F Scale and ask thL to “fill out this 


test which tells how authontarian 


int^*rpc».nr,x.w Though that might make an 

mtemsung exper.ment, it is just no, the way the mstrlmen, can L employed 

inlerprcltd as a Use* o/'lhe'^Mpe^mw another case which could be 

toward Ihesubieclm such a way as lo MBil n'*’’''*'’''''’' his behavior 

which will nol be described here are Prophecy These data 

report by a co author of a technical Dro!?^r n interesting m that they involve a 
co-author at a time when he was a tara'lM '’‘P'r"n'"''r * behavior toward that 
sophm, rated sub, eels eye view of un,„,endeS‘':xrenmen “r SavioT 



Animal Subjects 


159 


non, to introduce you to the field of animal research and overcome any fears 
that’you may have with regard to working with rats 

ms experiment is a repetition of work done on Maze-Bright “d MaK- 
Dull rats Many studies have shown that continuous inbreeding of rats Aat do 
well on a maze leads to successive generations of rats that do J 

better than “normal” rats Furthermore, these studies have shown that continu- 
ous mhreTding of rats that do badly on a maze leads to successive generations 

of rats that do considerably worse than “normal rats ♦ 

C generations of Maze Bright rats do much better than generations of 

of running Thereafter performanM S ou ^ ^ „„ the 

Those of you who are assigned the Maze uuii « 
average very little evidence of learning 5'^“' learning problem The 
The experiment itself will involve a platforms In 

animals will be rewarded only if t ey g response, the position of 

the other a dark gray _ m, conclusion of the expenment, a 

For the expenmenters use at th satisfaction 

questionnaire was constructed on subiects and a description 

with the experiment, their feelings about the sub,ects.^^^ 

of their own behavior “’’(7g"’"L,remely saUsfied) with inter- 

(e g , extremely dissatisfied) to +i t 8 cnace was also provided 

"“rs 

albino rats which ranged in age Ir differences in mean age per 

each were formed in such a way .„_nosed of two male and three 
group a minimum Each group was p 

female animals and ranged in mean g several days before the 

was housed m two cages, segregate y deprivation 

beginning of the experiment, placeo instructions 

The experimental proccdur instructor announced the details 

to expenmenters On the day 1 1 laboratory assistant entered 

of the final experiment of the had amsed Ins.ruc- 

the classroom announcing that the Berkeley 



10 


Animal Subjects 


In the last chapter a question was raised as to the generality of 
the effects of the expenmenter’s expectancy The expenments to be des- 
cnbed in this chapter were designed to extend the generality of these 
effects It was felt that a major gain m the generality of the phenomenon 
epended on the demonstration that expectancy effects might operate with 
different species of subjects Accordingly, the subjects of these expenments 
were rats rather than humans 


differences other than the change in subjects’ species 
expenments and the onginal ones employing human sub- 
studies, as in some of the later human studies, the 
offered no special incentives for obtaining data con- 
tn hp rip expenmental hypothesis In addiUon, in both the studies 
conduct h supervision was possible of the experimenter’s 

note instance*:^ There was, therefore, greater opportunity to 

tation as well as observation, recording, and response interpre- 

tation as well as any intentional errors b f r 


maze learning 

were 12 of the employing animal subjects, the experimenters 

psychos ZliTJ ' ^ course m experimental 

study was arranged as the.r last r,.!. 
employ animal subiects ThVr , 

each eapenmentcr (Rosenthall^d. wmten instructions were given to 

g.ve “h” "■""■“S this experiment is to 

P ^ y lunner experience in duplicaung experimental Ldmgs Sd in add. 
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conduct of the experiment. All reports made by these assistants were held 
in confidence and at no time was the name of a specific experimenter men- 
tioned. 


TABLE 10-1 


Mean Number of Correct Responses 


Experimenter 

Sample 

I 

2 

Research assistant 

1.20 

3.00 

“Maze-Bright” 

1.33 

1.60 

“Maze-Dull” 

0.73 

1.10 

“Bright” > “Dull” 

+0.60 

+0.50 

f 

2.54 

1.02 

p (one-tail) 

.03 

.18 


DAYS 




3 

4 

5 

Mean 

3.80 

3.40 

3.60 

3.00 

2.60 

2.83 

3.26 

2.32 

2.23 

1.83 

1.83 

1.54 

+0.37 

+1.00 

+1.43 

+0.78 

0.29 

2.28 

2.37 

4.01 

.39 

.04 

.03 

.01 


Table 10-1 shows the mean number of correct 
for those six experimenters who believed they were 
rats, for the six who believed they were runnmg 
the research assistant who was aware that t e ras 
nor dull but who was trying to obtain maximum 

Performance of the animals run by |f* "av ° "n 

bright was significantly better on the first, ou , combined 

addition, when the data from all fi« days of the ^penment were combmed, 

t was again significant, this group’ot experimenters 

Inspection of the day by ‘‘Y- performance increased monotonically 
shows that the “bright ^ The obtained monotonic 

as might be expected if J p^es in a hundred. The 

increase could be expected by y ^creased only to day 

“dull” animals’ performance, on the on the fifth. The 

three, dropping on ‘'’‘= as the' dflTefcnces between per- 

difierences in obtained J j less likely among rats run 

formance means suggest that » 

by experimenters believing them to ' j ,he experi- 

Table 10-1 also 

mcnt.thccxpcnmcntcrwho wasa performance 

obtain good P"'°.™="’" their animals to be bright (p < .05. 

than did the experimenters bclicMng i 
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tions were read to the expenmenters and explained further where necessary 
Each experimenter was then asked to rate on a 20-point scale how much 
he or she thought they would like working with the rats None had any 
pnor experience with animal subjects On the basis of these ratings, six 
pairs of experimenters were formed, matched on their estimated liking of 
the rats For each pair, one member was randomly assigned a group 
of subjects that had been labeled “Maze-Bnght,” while the other member 
of the pair was assigned a group labeled “Maze-Dull ” Thus, the ex- 
penmental treatment was the information that an expenmenter’s rats were 
Maze-Bright or Maze-Dull Actually, of course, the groups had been labeled 
bnght or dull randomly but with the restriction that differences in mean 
age per group per matched pair be at a minimum 

Before actually running any subjects, each experimenter was asked 
to rate on a 20-point rating scale (-{-10, extremely well, to —10, extremely 
poorly) exactly how well he thought his animals would perform Each 
subject received one hour of handling and maze experience before being 
run in the maze Dunng the maze experience, subjects could obtain food 
from either arm of the T-maze 


Each subject was run ten times a day for five days For each trial the 
experimenter recorded whether it was correct or incorrect as well as the time 
required to complete the response The darker arm of the maze was always 
reinforced and the white arm was never reinforced The darker arm 
appeared equally often on the right and on the left, although the particular 
patterning of correct position was developed randomly for each day of the 
expenment and followed by all experimenters 

It was mentioned that 12 of the 13 students m a particular course 
serve * c expenmenters The thirteenth student was an undergraduate 
worked for almost a year on the program of 
ihnt onu ^ ^ experiment was a part Although it seemed unlikely 
(jcarrii t knew about the existence of this re- 

were thirteenth student’s connection with it, steps 

The unite ^toimizc thc Iikclihood that such a connection could be made 
ment lus, participated in the expen- 

to pet as ennrt ^ experimenter but with the fully conscious motivation 
the fornrOip ormance from her animals as possible without violating 
Iss i^s An advantage of her being m this 

due of he cn iT --‘y observed the actual con- 

exo nmenta! as an observer of the 

sciousnessthat^miphiT* actually employed without arousing the self-con- 
the exoerimenfsl ^ "" incurred had the course instructor observed 

hs ex«r" , '"-I of 'he semester during which 

with the resps ^ f*"* oupcnmenters became associated 

with the research program He was thus also able to give valuable 
information on actual procedures employed by the expenmentfrs during the 
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to be bnght made their correct choices more rapidly than did the tats tun 
bv experimenters believing their rats to be dull 
^ Inspection of the day-by-day means for the two treatment groups 
shows that the “bright” animals tended to improve more steadUy than d d 
the “dull” animals The related question may be raised 
rats simply ran faster or whether they actually improved their 
compared to the “dull” rats Comparing the runmng time of the duU 
animals on their first and fifth days yielded a t of 
that this group did not improve their "^6 ^ 

able t for the “bright” ammals was 1 77, which has a p L ^ 

test), suggesting that this group probably did improve their performance 

dunng the course of the experiment actually a 

Table 10-2 also shows that the experimenter who was acmaUy 
research assistant obtained the shortest mean running P” 
sponse Except for day one, on which her ^ "Ventlrf^ 

^oup, her rats performed better than those run by f’^P" " 
fteir rats to be bright This trend serves to m etoT^^^ 

tion that an experimenter who is explicitly , g ,l,an jo less 

formance from animal subjects obtains ® “ P ^ f course, that by 

explicitly “biased” experimenters ° ) 

chance this particular expenmenter Jj ^ J to intentional 

To what extent could ‘he obtained resu t^ave been 

or other errors on the part “f ™ on ex^nmenter 

who subsequently worked with * but not all, of the 

expectancy had been ® P°^g,g „cre no observed instances of rats not 

actual expenmental procedures Tn pntnes on the data sheets 

actuaUy being run or of *= "g'^j ,„,,g„ces of deviation from pro- 

There was, however, a total of fi nrodded subjects to run the maze 

grammed procedure when expenm P g„,grs running • bright” 

Two of these instances occurred P running “dull” rats It 

rats while three occurred among ®’‘P® .guces of procedural deviation 
appears unlikely from this distn , ggtu,ent groups could be ascribed 

that the differences obtained between expenmenters 

to gross procedural or „£ ,i,e animals run by the research 

In addition, the superior performance „,g good 

assistant shows that intentional , rj believing them to be bright 

performance of animals run hy ®*P®" whether both groups of experi- 
A question of some interest whether only one of the groups 

menters were biased by their expe obtaining data no different from 

was actually biased, with “>= °f;,f““Pg°^ glven^no expectation Pnor to 
what they might have obtained a y asked to predict the per- 

running their animals, all . animals It was possible, therefore, 

formance they would obtain . jl^g oxperimcntcr expected to ob- 

to compute a correlation between the data the p 
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onc-tail, t = 238) While her obtained performance function was not a 
monotomcally increasing one, interpretation of this seems restricted by the 
fact that she ran relatively few animals compared to the number in the 
two cxpenmental groups Interpretation of the obtained t suggests that an 
experimenter who is explicitly ‘ biased to obtain good performance from 
amraal subjects obtains even better performance than do experimenters 
who are biased to expect good performance but not explicitly instructed to 
obtain it 

Of the 300 occasions when subjects were run (60 subjects X 5 
days) there were 60 occasions when the animal made no response at all On 
the average, then, one out of every five sessions the animals refused to 
make a choice This relatively poor performance may have been due to the 
difficulty of the discnmination problem the limiting of pretraimng to one 
hour, or the inexpenence of the expenmenters in running animals At any 
rate, these no-response occasions were not equally distributed between 
the experimental groups There were 17 such occasions among the ‘ bright ’ 
subjects and 43 among the “dull,* a division significant at the 001 level 

Since the “dull animals made fewer responses, it was possible that 
the results shown in Table 10 I were confounded, as animals responding 
more are likely to respond correctly more often In order to partial out 
the effects of greater nonresponding among the ‘ dull rats the mean time in 
minutes required to make only correct responses was computed for each 
ay separately for the two expenmental groups The obtained mean times 
are shown in Table 10 2 Although for any given day the running times 


TABLE 10-2 

Time Required to Make Correct Responses 


Experimenter 

Sample 

1 

2 

Research assistant 

5 45 

1 63 

'*Moie Bright” 

3 13 

2 75 

**Maze Dull” 

3 99 

4 76 

"Bright” < "Dull” 

+0 86 

+2 01 


DAYS 




3 

4 

5 

Mean 

2 04 

0 74 

0 68 

2 11 

2 05 

2 09 

1 75 

2 35 

3 20 

2 18 

3 20 

3 47 

+1 15 

+0 09 

+1 45 

+1 12 


one tail, ;_ 350) Thus, animals ran by experimenters believing them 
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different expectancies in both the experiments described in this chapter. 
Experimenters who expeeted good performance from their animals saw 
them as brighter, somewhat more pleasant, and more likable. These expen- 
menters were more satisfied with their participation in the experiment Md 
felt more relaxed in their contacts with the rats. They described then be- 
havior toward their animals as more pleasant, more fnendly, somewhat more 

enthusiastic, and less talkative. , ■ i, .t, „ 

Of course, we cannot be sure of the sense modality by which the ex- 
perimenter’s expectancy is communicated to the 

to visual, auditory, olfactory, and tactual cues (Munn, 1950). ^ 

the tactual, were perhaps the major cues mediating t e 
pectancy to the animal. The attimdinal ratmgs descnbed, which differe 
Lted the two groups of experimenters, may well have been hamlated mto 
the quantity and quality of their handling of the 

gests that experimenters expecting and obtaimng e JL . , „ 

handled their rats more and also more gently than ‘be “pe^^ 
expecting and obtaining poorer performance /^ter “ f 

second experiment employing rat subjects, further "e ^ 
seated tha? increased handling can improve performance (e.g., Bernstein, 

'^^At the end of each e^tperimen.er’s quertionn^^spa^ 

for any comments he might wish to ma handUng of *e animals 

the experimenters were unaware of the <hff^_^^ comments made it 

as a function of their expectancy. In . , being committed, 

appear still more unlikely that there were j feeling good when the 

Nine of the 12 experimenters spontaneous y P performed poorly, 

animals performed well, and feeling ba y experimental groups. 

These co'mments were equaUy L 

four in the “dull,” five in the bng . better if subiects performed 

peering poor performance stated ‘bat ay anything to worsen their 

Ltter,U seems unfikely that they would ba^donej^^^^^^ 

subjects’ performance, at least inten y jjjjjopstrate the “laws of 
demically important to the „„ the experimenters expecting 

learning” in his expenment, the P‘ „ and good learning. Any in- 

poor performance were to get good ^ ,bcrefore have operated to reduce 

Ltional errors, if they did occur. in 

those effects of the experimenters pc 
this study. 


OPERANT LEARNING 


menter’s expectancy on his anima I Lawson, at his iniita- 
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tarn and the data he subsequently obtained Such a correlation can serve as 
an index of the degree of expectancy effect In this experiment there was 
a shrinkage of the correlations due to the experimenters within each condi- 
tion having predicted what they were led to expect This decreased the 
vanation of predictions and, therefore, the correlations obtained The rank 
correlation between expected and obtained performance was 43 for the 
expenmenters running ‘bnght” rats and -{-41 for those running “dull” 
rats Since there were only six expenmenters in each group, these correla- 
tions did not reach statistical significance (although when the correlations 
were combined, the one-tailed p ranged between 12 and 007 depending 
on the method of combination) These findings suggest that the two groups 
of expenmenters were probably biased by their expectations to about the 
same degree, although of course in opposite directions 

At the conclusion of the experiment, each experimenter made ratings 
of his subjects, of his satisfaction with the experiment, and of his behavior 
dunng the experiment These ratings were designed to suggest the mecha- 
msms whereby the expenmenters unintentionaUy influenced their ammals 
to perform as the experimenter expected The mean ratings on these scales 
are shown separately for each group of experimenters in Table 10-3 Only 
t ose scales have been hsted which differentiated experimenters with 


TABLE 10-3 

Descriptions of Subjects' and of Experimenters' Be- 
havior 


Subiccts’ Behavior 

1 Bright 

2 Pleasant 

3 Likable 

Experimenters' Behavior 

1 Satisfied 

2 Relaxed 

3 Pleasant 

4 Friendly 

5 Enthusiastic 

6 Nontalkative 

7. Gentle handling 
8 Much handling 


BELIEF ABOUT 
SUBJECT 

'Bright" "Dull" 


-3 0 
4 8 0 0 

4 8 22 


3 0 2 5 

87 4 8 

07 28 

53 13 

55 02 

62 32 

65 27 

52 03 


TwO'Toi/ 

t p 


2 94 04 

1 77 15 

0 92 40 


2 10 10 

5 11 005 

2 56 05 

2 61 05 

1 51 19 

1 19 29 

1 95 11 

1 17 .30 
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home cages which had been labeled 

other group was assigned to home cages which ‘f“Lr ^d 

Box-Dull ” Early in the course, two of the ammals labeled Dull died 
so that the maximum number avaUable for the subsequent experiment w^ 
eiaht rats labeled “Bright” and six labeled “DuU.” All were on a feeding 
regimen of one-half hour ad lib access to. food dady throughout the eight 

"tsfctipment employed in the s^^^^ 

(Scientific Prototype Co.) demonstrauon Stanner boxes with feeders 

(1957), except that food pellets were used inste 

The questionnaire employed in the “ 7^tL^Mperinients, 

could rate their satisfaction with t^eir description of their own be- 

their feelings about their animals, a administered at 

havior during the conduct of the ^ Jed to this question- 

the conclusion of the study. A few new scales were 

.h, or te .«h 

five laboraeorjr EO"ods, lo laboralofj section, 

“bright” and one or two dull ra . ® that certain ex- 

could not be random, since there we Jun-atorv section. Within each 
perimenters were able to schedule eir ^ndomly assigned to the 

laboratory section, however, expenme experimenters were as- 

animals to be run during that sec ion. experimenters per subject 

signed to each subject, and the mean number of expen 

was 2.7. . .. „ different functions during each 

Each laboratory team performed th recorder. These func- 

of the experiments — ^that of experimen , laboratory team. For those 
tions were rotated among the mem e functions of timer and re- 
teams consisting of only Jlon. 

corder were usually performed by t nerformed, each of which is 

A total of seven experimen * P ^ (Homme & Klaus, 

described in detaU in the manual m 

1957). A brief description of each to • magazine and eat 

1. Magazine rrn'n'"S- Jra"""? ^ . „arc recorded for each click, 

whenever the feeder was clicked. latency on the first 

and the dependent variable was defined as 

and last ten clicks of the session. bar-press. Number of 

2. Operanl Acquisilion- ® jed, and the dependent vana- 

bar-pressing responses per " of responses during the first and last 

ble was defined as the mean number ot re p 

ten minutes of the session. i?,rnverv. Number of responses per 

5. Extincion and Spontaneoas Recover) 



166 


Studies of Experimenter Expectancy Effects 


tion (and has been reported earber, Rosenthal & Lawson, 1964) A consid- 
erable gain in generality accrues from this fact It was hinted at earlier and 
will be discussed in detail m Part III, but for now it is enough to make the 
point that replications conducted m a different laboratory are worth more 
than those conducted m one’s own Other gams in generality denving from 
this second expenment with animal subjects will be mentioned shortly when 
this experiment is compared more systematically to the one already 
descnbed 

In this expenment there were 30 male and 9 female students en- 
rolled m a course in experimental psychology to serve as the expenmenters 
At the very beginning of the course all experimenters were given the follow- 
ing wntten instructions 


Instructions to Expenmenters The reason for running these experiments 
is to give you experience in duplicating experimental findings and, in addition, 
to introduce you to the field of animal research and overcome any fears you 
might have with regard to working with rats 

^e experiments are all repetitions of work done recently on Skinner Box- 
Skinner Box-Dull rats Many studies have shown that continuous 
in ree mg of rats that do well on Skinner box problems, such as those you will 
be running, leads to successive generations of rats that do considerably better 
e these studies have shown that continuous 

wi!i h ^ ° badly on Skinner box problems, such as those you 

wnL successive generations of rats that do considerably 

worse than normal” rats 

worl^T^With^sv “Signed to a group to work with Some groups will be 

Box-dSh rat " rats, others will be working with Skinner 

your animals on^he'awr^^ assigned the Skinner Box-Bright rats should find 
early stages of each of ^ some evidence of learning during even the 

the average ve^° htUe cvrfen^rS'le ®°>t-Dull rats should find on 

not become discouraged since it 'n*® '"“u should, however, 

m time, learn the required responses ™ 

on breeding rats"fOT'bnghtncsTa''nSr' “P=”nients 

references to the work dLe by Trvon and“VJ°" '"^nuctors can give you 
at Berkeley and elsewhere ^ ^ others at the University of California 

rats (all 80 "ays oldf dratn"from thr""'"! 'o'’o™'o'y 

Ohio State Unnersily DepartLent of “lony maintained by The 

assigned to one of Jo orLps One randomly 

g p One group of eight rats was assigned to 
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menters, 39 instead of 12. In addition, this was a longitudinal study lasting 
about 8 weeks and a minimum of 14 hours spent with each animal, while 
the earlier study lasted 1 week with only 5 hours spent with each group of 
animals. In the present study, in spite of rotating their team functions a 
experimenters spent a minimum average of four hours working with th 
rat, whereas in the earlier study no experimenter spent more than one hour 

with any one of his five animals. , , 

In Ae earlier study experimenters worked alone and were * 

time unobserved by the laboratory supervisor. Whereas 
procedural deviation that came to light were found to randomin.s 
Luted over the two treatment conditions the ^ 

better control over this possibility, since a laboratory 
during each of the laboratory periods. Perhaps more 
control of procedural deviation was the contro o handled 

Thus, if an experimenter, because of his belief " ,he 

the animal rouW the laboratory instructor was 
experimenter tLt his rat would never 

In the present study, too, the '|'°tivati<)ns o e ^ P j j; better 

different. In the earlier study it was found that exper meme 

when their rats learned well 1 ^“' !'’“® Let had to learn in order 

learning well. In the present situation th ...a. nnd eo on to the 

that thf experimenter could write a report, get a grade, and go 

next study. . aiff„ence was possibly associated with 

An additional motivational differ P present 

the differing roles of the laboratory ° instructor reinforced the ex- 

study. In the earlier study, the lone la or ^ ar-nunted for by the rats’ 
perimenters’ beliefs that poor performance was only one 

“dullness.” As it happened, and ^LSher insfructor, as it happened, 
of the three laboratory instructors did . jugness, while the third in- 

evaded any reference to the rats brig analysis 

stractor told his students that ”“Louite accidentaliy, then, a small 
as a dull rat, only a dull experime • favorable to the 

sample of “climates” was acquired app Lts. This variation in “cli- 
occurrence of experimenter expectancy generality of any obtained 

mates” would serve to increase somew a , experiments in 

findings. Any one team of expenmenters p 

only one of these three climates. revealed that for several of the 

Preliminary inspection of the resu s 5 jgat the use of interval 

experiments there were such extreme y ® in each experiment, the 

scale statisties seemed inappropriate. the'treatmcnt effect evaluated 

obtained scores were converted 1 ° average each experi- 

by means of the Mann-Whitney U es . „n(.rimentcrs from eaeh treat- 
ment was not conducted by some tea treatment group was not 

ment condition, the mean raw rank for 
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minute was again recorded, and the dependent variable was defined as the 
number of minutes elapsed until the animal showed two response-free min- 
utes Data were analyzed separately for the two parts of this experiment 

4 Secondary Reinforcement In this experiment the animals’ re- 
sponses were reconditioned and partially reextmguished Subsequent re- 
sponses were reinforced by the clicking sound without presentation of food 
The dependent variable was again defined as the number of minutes elapsed 
until the animal showed two response-free minutes, while getting click 
reinforcements 

5 Stimulus Discrimination Training the rat to bar-press only m the 
presence of a light and not in the absence of the light For each trial of this 
experiment the experimenters recorded the latency for the reinforced re- 
sponse and the number of responses occurring under the nonreinforced 
wn ition until a critenon of 30 seconds of no responding had been reached 
^e dependent variable was defined as the ranks of the mean latencies of 

e rst and last ten trials added to the ranks of the mean number of non- 
reinforced responses during these same trials 

^ Demonstrating that animals trained to 

resnnnc-*^ I pf^sence of a UO-voU light would show a decrease in 
0v^Forp?r^ 'vas decreased to 70 v, to 35 v, and finally to 

and thp ^ periods, the number of responses was recorded, 

that his rpcnrt was defined as the probability for each subject 

have occuitm' 1!^ ecrem^ts as a function of stimulus decrements could 
be identical or The ranks of these probabilities would, of course, 

decrease ' ^ ranks of any other index of monotonic 

was foUowed^bv^thf Conditioning a loop-pulling response which 

“'"P^^edch..„sdun„;;e“di:sT.e^^^ t-e mean number of 

2-hour penc^'" ‘hese stud.es m one 

which was allotted two nenodT^r!."® 'I"® ®“mulus discnmination study, 

study mthm the scheduled tme thevTd!'" ^ 

free time and conUnue working unUUhe ^"i!™ ■" 

the next scheduled expcnment Even *“ “ 

the expenmenters were all well m the last experiment, then, 

well as possible >not.vated to have their animals learn as 

Comparison with the maze leirni„„ 
differences between this and the first stuyTt,™'”i' 
fercnt unnersiues using different Im 
study there were fewer^uwL ,4 ’"d ^ 

j * compared to 60, but more expen- 
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then that experimenters’ belief or expectation about the performances of their 
animals was responsible in part for the performances obtained. 

Inspection of the p levels for the eight comparisons supsts no trend 
for subsequent treatment effects to become either more “ 

The combined p level for the first four comparisons was .035, and for 

last four comparisons it was .025. Thnt is did- 

The question of correlated performances should • ’ 

the differences between the treatment groups arise 
ment and then simply maintain themselves over “t 

The answer to this question will tell us in part “ 
ments were nothing more than a single expenme P percent 

In Table 10-4 the last column shows that in “ „„S1or 

of the variance of performances in any expenme correlation 

by the performances in the preceding and 

between performances m test. A good illustra- 

generaUzation was significant at the . ’ was not sufficient to 

tion that the degree ,e experiment is provided by 

regard the seven expenments as only eroeriment in Table 

examination of the results of the conelamd .45 with their 

10-4. In that experiment ™ ,^55 correlation accounting for 

performances in the preceding expenm . obtained mean 

about 20 percent of the variance m spde onhis.J^^^^^ 
difierences in prformance differed significantly from 

the opposite directions. rf„^ances from experiment to experiment 

Although the animals perfo subsequent expenments, 

were not accounting for much of t better predictors of subse- 

there was a tendency for later performance correlations was 

quent performances. This a„ increase suggests that, oyer 

significant at the .01 level (r/jo — +• • moj-e “permanently” affected 

tiL, the animals may have been more and more p 

by their experimenters’ jo treatment conditions had been 

The original assi^ment of subjects x 
random, but the question may fai y briahter, especially in view of 

labeled “Bright” might not in , be^answered directiy, but the 

the small sample size.' This ' obtained results can be evaluated. 

likelihood of this factor accounting tor t differences among 

If the obtained results had been due to p ^ expected 

the animals rather than to the la e ng between subjects’ performance 

correlations differing significant y ro . ,b. subsequent experiment. As an 

in an experiment and their performance comparison was ma e. 

additional check on this question, experiments I and II were 

: - ■— - ■- 

1 Max Bershad and Leon PrilzKc 
of the issues involved. 
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comparable from experiment to experiment. In order to achieve compara- 
bility of mean ranks across expenments, and to legitimize their addition, all 
ranks were converted to Guilford’s (1954) C-scale scores. 

Table 10-4 shows these normabzed mean ranks for each treatment 

TABLE 10-4 


Mean Ranks of Operant Learning for Seven Experi- 
ments 


BELIEF ABOUT 
SUBJECT 


One- To// 


Experiment 

"Bright” 

■•Dull" 

P 

1 Magazine 

training 

4 A 

5.8 

.13 

H Operant 

acquisition 

4.3 

6.2 

.09 

III 

A Extinction 

4.2 

5.8 

.12 

B Spontaneous 

recovery 

4.6 

5.0 

.48 

IV Secondary 

reinforcement 

4.7 

5.5 

.17 

V Stimulus 

discrimination 

4.0 

6.3 

.008 

VI Stimulus 

generalization 

4.3 

5.8 

.02 

VII Response 

chaining 

58 

3.8 

.92 

Meons (Total) 

4.5 

5.5 

.015 


Correlation 
with Preceding 
Experiment 


.25 


.08 


.25 

.37 

.38 

.59 (p < .05) 

.45 

.35 


SwTthThe performances m that expen- 

by chance was 015 (one-taill In. ^ Bright” could have occurred 

imparisons ahows .1:" ^'^'v^^TJhu" one'’’^ 

when the experimenters expected a sunenor 

F a superior performance It appears bkely 
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the questionnaire descnbed earlier Table 10 6 shows the mean ratmg lor 
each treatment condition on each of the scales for which the results were 
given for the maze learning experiment The last two scales were new for 
L experiment and the “amount of handling” ratings were made separately 
lor handling before each experiment and after each experiment 

TABLE 10-6 


Descriptions of Subjects' ond of Experimenters' Be- 
havior 


BELIEF ABOUT 

SUBJECT QffQ Tail 


Subjects' Behavior 

1 Bright 

2 Pleasant 

3 Likable 

Experimenters' Behavior 

1 Satisfied 

2 Relaxed 

3 Pleasant 

4 Friendly 

5 Enthusiastic 

6 Nontalkative 

7 Gentle handling 

8 Much handling 

a before experiments 
b after experiments 

9 Watching subiects 
10 Talking to subiects 


'Bright" 

"Dull' 

5 0 

-2 6 

52 

37 

4 1 

22 


9 1 

66 

63 

6 1 

64 

53 

5 8 

3 9 

4 2 

1 9 

-0 2 

-2 7 

5 8 

57 

(-1 0) 

(-2 8) 

-1 2 

-2 3 

-0 8 

-3 3 

93 

83 

-3 1 

07 


t P 

2 64 02 

1 07 16 

1 28 12 


4 40 0005 

2 04 04 

1 31 11 

1 31 11 

1 11 15 


1 17 14 

2 16 03 

2 41 02 


Both 

Studies 

Combined 

P 

002 

05 

08 


0003 

03 
005 
02 

04 
07 

13 

( 10 ) 

14 
07 


In this study, too, i” ‘expenments than 

sigmficantly more satisfied with t eir p However, even these latter 

were those believing their anima s ° rfi 6) compared to either the 
expenmenters were remarkably those running “dull’ rats 

experimenters running ‘ bnght ™ ® treater satisfacUon of the expen- 
(2 5) m the earher study This _ to the nature of the 

raenters in the later study may ,5 ^vere an integral part of the 

expenments performed These ex^nmen d,„,onstrate were 

course content, and the principles they were g 
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matched with those four “bright” rats who also performed in both expen- 
ments and whose performances in experiment I were most similar to those 
of the “dull” rats The mean normalized rank of performance in expenment 
I for the four “dull” rats was 5 5, while for the four “bnght” rats the mean 
was 5 8 The mean normalized rank of performance in expenment II was 
6 0 for these “dull” rats and 3 8 for these “bnght” rats, the difference being 
significant at the 10 level, one-tail U test Thus, when considenng experi- 
ment I as the basis for “preexpenmental” matching, the subsequent expen- 
ment showed no change m the direction of difference, or the degree of its 
significance, from what was obtained without preexpenmental matching It 
seems reasonable, then, to assume that if preexpenmental differences in 
abihty favored the “bnght” animals, this could at most have affected only 
the results of expenment I 

It was mentioned earher that all animals had been assigned to one 
o ^e laboratory penods, one or more of which were supervised by one 
of three laboratory instructors It was also mentioned that each of these 
ms ructors appeared to provide a somewhat different “climate,” which might 
e in erprete as more or less favorable to the occurrence of experimenters’ 
expec ancy effects Table 10-5 shows the normahzed mean ranks fur all 


TABLE 10-5 

Mean Ranks of Operant Learning for Five Labora- 
tories 


Loborofory 

A 

B 

C 

D 

E 

Meons 


belief about subject 


Bright” 

"Dull" 

One-Toj/ 

P 

43 

53 

08 

4 9 

65 

07 

5 1 

5.8 

.25 

3 7 

4 6 

21 

4 1 

6 0 

07 

44 

56 

.02 


the expenments combined for each 

In aU Bve laboratories the treatment IT?™ >*”atones 

with p levels ranging from 07 to , '■>= predicted direction 

differences in obtlnld p levels for suchT P < 0°^ 'PJ' 

not seem to warrant elaLrate mterpmUhor"^''*”?" 
that “climates” or lab penods did Zt . seems safe to saj 

At the conclusion^ ex^nlm 

penments, each experimenter filled out 
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We cannot decide easily whether this differential postexpenmental rein- 
forcement was only a consequence of the subjects' performance or whether 
It was a partial determinant of that performance It might weU have been 

Also in the operant learning study, expenmenters kept a ^ 

on their rats’ behavior if they expected better performance, although aU 
experimenters watched their animals very elosely In f 

studies, closer observation of the subject may 
and more rapid reinforcement of the response 
mg, perhaps due to the 
responses to be seen, may have made better 

each experimenter to say m his own wor s ^jio 

msnts Nineleen complel|^ yfnTn w'rrrece,v.d from llK«e who had 

“,3,”dV:S' «; To 7 .h<-a .ha ,a...o..da h»«P 


TABLE 10-7 


Spontaneous Comments by Experimenters 



BELIEF ABOUT SUBJECT 

One-Tail 

Comments 

"Bright’ 

■ Dull 

P 

1 Beneficial 
experience 

63% 

41% 

16 

2 Interesting 

experience 

53% 

18% 

04 

3 Uneducable 

5% 

47% 

007 

subject 


4 No comments 
made 

0% 

12% 

22 


d f 1 ) the benefit they de* 
of expenmenters who ^'-.-resting the expenments were, 

nved from the expenments, (2) how mt^asU g ^ 

(3) the difficulties of the pa.tem 4 expeet from the 

of spontaneous responses follow 

analysis of the more formally coded r p „y .nteresung ‘ Our rat. 

One of the open-ended comments was esp y 
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covered in lectures by the course instructor In the earlier study there was 
relatively much less relationship of the expenment to the content of the 
course Furthermore, in the earlier study, although the “bright” rats learned 
faster, none really learned well In the later study, although “bnght” rats 
again learned faster, almost all ammals did learn eventually 

The overall descnptions which differentiated the two groups of ex- 
penmenters were much the same as in the first ammal study The last col- 
umn of Table 10-6 shows the combined probabilities derived from both 


experiments For both experiments, expenmenters believing their subjects 
to have been bred for good learning judged their rats* behavior to be brighter, 
more pleasant, and more likable These expenmenters were also happier 
about their conduct of the expenment, and more so in this than in the 
preceding study That makes sense, because m the present study, expen- 
menters had much to be dissatisfied about if their animal learned poorly 
They had to come in after hours and get their animal “caught up ” 

In both studies, expenmenters assigned “bright” rats felt more relaxed 
in their contacts with their animals and felt their own behavior showed a 
more pleasant, fnendly, and enthusiastic approach These more global at- 
titudes may have been translated more specifically into a less talkative “in- 
eraction with the animal (one wonders what expenmenters might have 
en saying to their dull ’ rats), more handling, and more gentle handling 
Uee would expect, the absolute amount of handhng was considerably 
rpcrnl^i ^ learning experiments than in the maze learning study, 

h/nrthn^V^? experimenters’ belief about their ammals* ability What 
vevmp fti ° 1 operant learning studies was confined to con- 

back again In the 

were handlpH^ ®®aimals were sunilarly handled m transport but also 

Tt™ In ‘be starting box of 

of handliTip nf ^ ®PC^ant learning study separate descnptions were given 
® ° ‘be expenments Table 10-6 sLws 

about 33 nerpp cxpecUng better performance handled their ammals 
SctiL POO '"I expenment, whereas expenmenters ex- 

each expenment handled their ammals about 44 percent less after 

even among expenmentem^xpen,nr’*”"'“rf 

for the first einenm, f J ’'P^'^hng poor performance That was not true 
orato^ been dne to the presence of the lab- 

Herefore, most of the taSmronte^e “'T''™ bandhng 

positively reinforcing to the aLals Px" “ 

formanee may have rewarded them mts^^'^i n r 

and such reward may have imDr™!!i 

subsequent expenment tpe;” .xt T 

held their positive tactual rLfnr. oapecting poor performance with- 

haps beean^e thire wt llttTe t b “Tr P"' 

e even unintentionally reinforcing about 
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were performing more poorly, a fact that would tend, of course, to offset 
the treatment effects 

What can be said specifically about the several operant learning ex- 
periments showing greater or lesser expectancy bias’’ certain t^es o 
tasks that rats may be called upon to perform more ^ 

mg effects of the experimenter’s hypothesis’’ It seems doubtful that the data 
can answer this question We may feel most confident in the 
tendency to obtain biased data on stimulus discrimination and 
tion type experiments However, it might prove most use ul, for 
at least, to regard the median obtained p level o as 
the median p level to be obtained, with similar sample sixe , if we were to 

— .x pop— — 

this view, our more extreme p levels, tnose ciosci 

to one, would be regarded as sampling fluctuations ouenests that 

Later in Part If some evidence 

expenmenters’ descriptions of their own '’fh;v>or dunng thejxpen^^^^^ 

are borne out rather well by „o independent check 

In these studies employing animal subjec expenmenters But 

from the subjects as to how can do no 

as a source of possible interpretations of , ,.if.(jescnptions 

harm to assume the vendicality of the ®’‘P®" behavior toward their sub- 
ShaU we, then, regard the expenmenters "r tow 

jects as antecedents or as consequents ,^behavior as both Thus, 

haps It makes most sense e„,n,als to perform poorly 

initially, those experimenters expecting oroduce dull behavior, 

treated them in some subtle fashion sue nerformance treated their 

whereas those experimenters exfrecting ng (jgaunents accorded the 
rats accordingly Those initial (.^s by subjects which could, 

animals might have led to P® , a„ons abLt their animals and 

in turn, reinforce experimenters p , ■ bnght” and “dull 

maintain the subtle differences in the treatment of g 

■■els L I, „ PTtierimenter commumcates his ex- 

The specific cues by ® ^ Pgries with the type of ammal, the 

pectancy to his animal subjects pro y experimenter With Clever 

type of experiment, and perhaps even yp ^ auditory cues were also 
Hans as subject, the cues were pnraan y > j ^^,e,e jogs rather 

helpful That seemed also to be true when the suPJ 

than one unusual horse t hv H M Johnson (1913), who 

The experiments were s Johnson believed that the al- 

knew of Pfungst’s work with Cle experimenter s 

leged auditory discriminations shown y ^ expectancy that such 

unintentional communication to t e a Questioners betrayed their ex- 
discnmination was possible Just as a did experimenters 

pectancy of the horse’s ability to answer quest 
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number X, was m my opinion, extremely dull This was especially evident 
durmg traimng for discrimination Perhaps this might have been discourag- 
ing but It was not In fact, our rat had the ‘honor’ of being the dullest in 
all the sections I think that this may have kept our spirits up because of 
the interest m [our] rat ” As a matter of fact, the animal in question 
was one of the two animals performing at the median level on the discnmi- 
naUon problem as well as for all the cxpenments taken as a whole The 
cited comment serves to point out anecdotally the importance to the experi- 
menters of the type of rat they were running None of the 34 wntten com- 
ments even remotely suggested that any expenmenter was aware that the sub- 
jects had not been specially bred The impression of the three laboratory 
instructors confirmed this lack of suspicion on the part of the expenmenters 
ju ® after the experiments and questionnaires 

had been completed, the entire study was explained to all the expenmenters 
Here appeared to be great interest and animation on their part One reaction, 
oug , was surprising, and that was the sudden increase in sophistication 
expenmenters who had been assigned “dull” 
♦! ^’'perimenters pointed out that, of course, by random 
thev^conli ^ A ^ groups of rats would not differ on the average However, 

suc/a phenomenon “““P'' 


SOME DISCUSSION 


expectancies =*P=nments reported suggest that expenmenters’ 

aeamh emlymLn.2r^r‘ oflhe results of their ra- 
the results of the^two expcnments combined probabdity that 

the mediauon of this exnecinnn, u particularly, suggest that 

subtle It appears unlikelv th ^ '”“'"8 phenomenon may be extremely 

vanous laboratory instructors h ® ^ “nnoticed and uncorrected by the 
of the expenmenters via the lernmna *‘'r the learning 

however, whether the laborato “ subjects The question occurs 
observers That is a possibilitv\I?‘?''^‘”® '"‘8*'' "“t have been biased 
structors seemed to have different h* " tecalled that the three in- 

tnent, yet in each one s laboratorv ” o™ntations toward the expen- 
addition, the teaching function of th, il'*'''**'® “1““® comparable In 

dimmish the effects of their student.- instnictors was such as to 

tended to give more help and advL “Pjf That was because they 
to the experimenters whose animals 
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tion, however, that the subjects’ responses might have been affected by the 
experimenters’ expectations. Visual, olfactory, auditory and tactual cues 
do not seem likely candidates as the channels of unintended influence of an 
experimenter on his worm subjects. But perhaps changes in r^spiraUon of 
the experimenter affected the turbulence of the water ^ 

planaria swam and inffuenced them to respond “ 

perimenter’s respiration may be affected by his expectation P° ’ 

of course, by Johnson, though for his dogs such changes meant visual cues, 

rather than mechanical stimulation. is an 

What seems to be needed in the area nCl ffor use 

experiment suggested by Wernicke and desenbed by Moll (^lOHfor use 

with human subjects) in which a P ^ ,his reduces the 

perimenter and, in . ; ^^^^'l^that the behavm^ 

amount of “observer error. li it does, ii m > ^ffprred bv the unin- 

planaria can, like that of horses, dogs, and rats, be affected by 
tended communication of the experimenter s expec ^ clever ob- 

This chapter may be concluded ^ tStclHo the 

servation by Bertrand Russell, who, o > ^ f ,l,e unpro- 

effects of the programmed experimental p ocedures man 
grammed effects of the experimenter’s expectancy (1927, pp. 

The manner in which animals " 'J!^enrc^^ results^ave 

with a great deal of patient have been invesUgated, but 

been obtained as regards the kin^ of p One may say broadly that 

on general principles there is stiU m* hive behaved so as to confirm 

all the animals that have been carefu y before his observations began, 

the philosophy in which the obse^^ e ' characteristics of the observer. 
Nay, more, they have frantically with an incredible display 

Animals studied by Americans rush a u . , result by chance. Animals 

of hustle and pep, and at last evolve the solution out of 

observed by Germans sit still and think, and at last 

their inner consciousness. 
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betray to their canine subjects how they should respond to confirm the 
expenmenter’s expectancy The specific cues, Johnson felt, were the ex- 
perimenter’s posture, respiration, and the pattern of strain and relaxation 
of the muscles of the head and body Just as in the case of Hans* question- 
ers, such cues were obviously of an unintended, involuntary nature As a 
control for the Clever Hans phenomenon, Johnson conducted the standard 
series of experiments on discnmination, but with the modification that the 
dogs could not see him at all To control auditory cues at least partially, 
Johnson suggested that the experimenters not watch the dogs’ responses so 
that they could not respond differentially and involuntanly as a function of 
whether the dog’s response was the expected one When all the appropriate 
controls had been employed, Johnson found that dogs could no more per- 
form the discnminations with which (hey had been credited than Hans 
could solve problems of calculus 


When the subjects are rats instead of horses or dogs, the unintended 
cues from the experimenter might also be visual or auditory, but they could 
also be olfactory for all the little that is known of the matter at the present 
time The best hypothesis to account for the results of the two expenments 
descnbed in this chapter is probably (hat the quality and quantity of han- 
dling communicated the expenmenters’ hypotheses In the study of operant 
earning, closer observation of the rats’ response could have led to more 
clever teaching of the animals believed to be bnghter But that explanation 
would not do for the maze learmng experiment Handling differences seem 
explanation for both expenments Animals believed to be brighter 
fi 11 P easant may well be handled more "pleasantly,” and less fear- 
helin'vmr^^ gently and more often Such handhng could alter the animals’ 
greater changes in handling patterns Chnstie 
nenmenterhlH . -tilc to postdict which ex- 

a maze or while ^ observing the rat’s behavior while in 

observations is n w “P Support for these and similar informal 

rats that are hand^rt ^ ^ formally collected data which show that 

Rom .tTxnenl ,T' 1952. Bernstein, 1957) 

role of handhnp naft * in this chapter, we cannot be certain of the 

nor o Wh” ,hef ST' ‘'’n "I expenmenters' expectanaes, 

Tre ntlt? “ «'= “'f-tory, and auditory 

would cTear^pt^^^^^^ -“><1 be ?;rfonned. that 

Cordfrf rn‘^aTsoraV6T)Ta?dTsc h ™ 

same paradigm as that descnbed^m “Penment employed the 

were flatwoms (planana) Exnen Jf**, 

planaria which were dramL^U?,nThfr' ’''sponses from their 

results, very reasonably, were interortLd‘'“!i°" 
the worms' responses It cannot observations of 

e ruled out as an alternative interpreta- 
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Other than the advancement of science. These include the tulfilhng of course 
requirements, pay, or the hope of improving personal adjustment. 

Criswell (1958) lists these motives and adds curiosity about research, 
boredom, less pleasant alternative pursuits, and a need to ingratiate oneself 
with the experimenter. This last motive also helps explain why subjects who 
correctly “read” the experimenter’s unintentionally communicated ex- 
pectancy generaUy go along with it rather than choosing to disregard it or 
to defy it. (Jones [1965] has pointed out that successful ingratiation requires 
some subtlety rather than simple compliance. Simple compliance leads to a 
relative loss of esteem. In the experimenter-subject interaction, the subject s 
going along can hardly be eaUed simple eompUance, since the “requests for 
certain responses are unintended or covert.) Going along with the expen- 
menter’s covert request satisfies the ingratiation motive subUy while at the 
same time satisfying the motive to make a useful contribution by confirming 
the experimenter’s hypothesis, as Ome suggested. , , . i 

Other workers have stressed the social nature of the psycholo^cal ex- 
periment (e.g., Bakan, 1953; Friedman, 1964; Mills, 1962; Tuddenham, 
1960). One of the most important and one of the most sysmmatic analyses 
of the social nature of the psychological experiment was that by ^ccken 
(1962). After describing the features charactenstic of 
notes three aims of the subject. The first of 

those rewards he feels his due from having “ 

participate. These rewards may include course credit, ^ 

logical insight. The second aim of the subject is to P"" “P^” 

mfnter’s inscrutability and discover the rationale of 

third aim of the sub ect, tor which the second aim f.. Jj” 

“represent himself in a favorable light” or put his best 

third aim of the experimental subject is also 

berg (1965), who has shown the systematic effects that evaluation appre 
hension” may have on the outcome of the expenmen . ^ 

able evaluation. The solution to th J formally programmed 

his preconceptions of P^y'^P^'^mtophy^"^ scenHnd" ™nf die un- 
procedures of the experiment, fro P^^^^ -^^^ter’s unintended corn- 

programmed “procedures such 

munications. A “‘‘'”P'= dLten^problem comes from a comment by 
on the subject s solution of his ° P on affiliative behavior, he 

Veroff (1960). In reviewing a research progr 

wondered whether the amount of s Relations.” Such 

the sign which ‘yp°^ta„t for aU conditions of an experiment so 
scene effects are bkely to be consta 
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Did I do nghP” That was the question in the mind of one of the 
subjects She had rated the standard 10 photos and, along with other sub- 
jects, had been asked to tell her feelings about the experiment She did not 
mean by this question that she worried whether she earned a good score on 
the empathy test,” though that might have been part of it She was more 
worried whether she had performed properly her role as “Subject of a 
syc ological Experiment ” Another subject verbalized it, “I was wonder- 
ing If I was doing the experiment the way it should be done ” That subjects 
m psychological experiments think and worry about such matters has been 
pointed out increasingly in the last few years “Part of the expenmental 
mo ♦ Cnswell, “relates to performing adequately as an experi- 

Tnln r P 'his Chapter the discussion will be of 

expectant complicate the effects of the expenmenter’s 

to (1962) has shown the lengths to which subjects will go 

exnernnentfll ^ ® Fo*" some years he has been trying to find 

would refuse to do^^th^ meaningless that expenmental subjects 

Ce b en II Vk discontinue them No such tasks 

r 

means ultimately that the Orne, being a good subject 

hvDothesis subject wants to validate the expenmental 

question that may hre ok umd loT f 

exDenmpnt^»Tc o/ some readers of this book Granted that 

do^sZcts a«^ """ expectations to them subjects, why 

to do partiallv fn th ‘'’ese expectations^ Orne’s answer seems 

ZnyLZc ^nll “■"= °‘»ers There seem to be too 

ZlstrSr „ -‘i-flerent, or too disturbed, or 

pnmary ones * Orn ^ scientific motivations to be always the 

pnmary ones Orne hsts motives for subjects' part.cipaung m experiments 



183 


Subject Set 

standardized senes of 20 photos of faces descnbed earlier Subjects were 
asked, as before, to rate each photo on the apparent success or failure that 
the person pictured had been expenencing This time, however, expen- 
menters were instructed to reinforce all positive ratings made by their sub- 
jects Each expenmenter was individually trained by an investigator, who 
did not know to which treatment condition the experimenter would be 
assigned The exact instructions to expenmenters and the instructions they 
were to read to their subjects were mimeographed and given to each expen- 
menter at the conclusion of his training session 


Instructions to Expenmenters You have been asked to participate m a 
research project studying the phenomena of condiUonmg The reason for yo^ 
participation m this project is to standardize results of experimen^ 
ronditfoning There is the problem m psyehological research of different ex- 
aminers getting somewhat different data on the same tests “ ^ 

individual differences Therefore, to standardize the tests it is better methodo 

logical procedure to use groups of expenmenters fmm each 

You wtU now be asked to run a series of subjects and obtain from each 
ratings of photographs The experimental procedure is as follows 

sheetflL'd r^^dTnSe 

sheit Continue this procedure through the 20 photos Do not let any subject 
rchTul^crtotTthVr^t m^^ of the 20 photos and find die average 

^■"'previous research m verbal condiUoning has shown that 
conditioned to give a certam ™ ,he number five (-1-5), and 

want you to say good ^ ^ over Do not say anything for 

‘ excellent” after every rating of plus " ciinrtlv be receivinc very high 

minus ratings As you would suspect, you should shortly be receiving ry g 

ratings from your subjects, about “ + " " j subjects arc such 

The Marlowe Crowne Social r /ery likely be awarr of 

that they, on a postexperimental J"''™' testVhc Marlowe-Crowne) is able 
having been conditirmed That is to s y, ^ conditioned 

to predict beforehand which subjects reliability of the Marlowc-Crowne 

The present study is designed to «nfy u,cm except 

Just read the instructions for any reason you should 

hello and goodbye and is written in your instrucUons, 

say anything to a subject situation which forced you 

please write down the exact words yo 
to say them Good Luck! 

f ooinP to read >ou some instructions I am 
Inslruclions to Subiecls I ^ g E instructions, nor can I answer 

not permitted to say anything which 
any questions about this experiment 


* This word was 


.nserted ,n the instructions to halt of Ihc cxrcnmcnlcrs 
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that the inferences drawn about expenmental effects need not be affected 
Nevertheless, it would be interesting to change the signs from time to time 
to see to what extent affiliative behavior occurs in “TTie Laboratory for the 
Study of Social Conformity ” 

Such cues to the solution of the deutero-problem have been called the 
“demand characteristics” of the expenmental situation by Ome (1962) 
He has shown m his research program that m a vanety of expenments, sub- 
jects perform as they believe they are expected to perform TTius if subjects 
beheve that hypnosis imphes catalepsy of the dominant hand, they show 
such catalepsy when hypnotized If they are not led to beheve such catalepsy 
to be part of hypnosis, they do not show it when hypnotized (Ome, 1959) 


EXPERIMENTER EXPECTANCY AND SUBJECT SET 

One purpose of the experiment to be described now was to learn of 
the effects of demand characteristics operating independently of but jointly 
with expenmenters’ expectancies A second purpose was to test the gener- 
ahty of the effects of expenmenters’ expectancies The studies reported so 
far have estabhshed the occurrence of the phenomenon m the research 
domains of human perception and animal learning Here the occurrence of 
t e phenomenon is examined m a different but equally lively area of re- 
search Such an area is that of verbal conditioning (Krasner, 1958), and 
one of Its more hotly debated aspects is the question of the role of awareness 
conditioning (Dulany & O’Connell, 1963, Enksen, 
thff ^P‘®^^®rger & DeNike, 1966) It should be emphasized 

nurh I * was not to answer the question of whether 

lenrn without awarcncss can occur The purpose, rather, was to 

bv thp nh of the role of awareness in learning might be affected 

expenmenter expectancy effects and the effects of 
demand characteristics or subjects’ set 

in I**"* possible role of demand characteristics 

vided by Kras^r a9°587H™o'VV‘“‘‘r conditioning is pro- 

verbal condit,r.«.„ ^ subject who, during the course of a 

tingencv On the \ spontaneously verbalized the correct con- 

subiect gave nerfe H inquiry for awareness, however, this same 

mrghtboaccounted%Lbyfcru'biS‘’™''' 

terist.cs of the situation as bem^X 

tingeney if yon wish to regard y™rslras°a® "h ‘ ‘n 
The exnpr,m«„» 1 , L as a good subject 

Vikan-Klmef & Fode ^9631? ^ elsewhere (Rosenthal, Persinger, 

Each experimenter presented to each oj his subjects individually the 
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The Second Questionnaire. 

1 . Did you usually give the first number which came to your mind? 

2. How did you go about deciding which of the numbers to use? 

3. Did you tbinV you were using some of the numbers more often than others? 
Which numbers? Why? 

4. What did you think the purpose of this experiment was? 

5. What did you think about while going through the photos? 

6. While going through the photos did you think that you were supposed to 
rate them in any particular way? 

7. Did you get the feeling that you were supposed to change the ratings of the 
photos as you were giving them? 

8. Were you aware of anything eke that went on while you were going through 
the photos? 

9. Were you aware of anything about the experimenter? 

10. Were you aware that the experimenter said anything? If so, what? 

Note:. Answer the following questions only if you were aware of anything said 
by the experimenter. 

11. What did the saying of the word or words by the experimenter mean to 


12. Did you try to figure out what made the experimenter say anything or why 

or when he did? , , • 

13. How hard would you say that you tried to figure out what was maiong the 

experimenter say the word or words? . . . „ 

very hard fairly hard not hard at ^ 

14. What ideas did you have about what was making the experimenter say the 


15. mae°goTngtfaough the photos did you think that what the e^^enter 
said had anything to do with the way that you rated the photos? How? 


AU awareness-testing questionnaires were scored 
ently, and without pretraining by two psychologists according to ‘h' =ntena 
set forth below as modified for this study from the “■''"‘I 
Mataraxzo, Saslow, and Pareis (1960). The sconng ^ 

structed b; asking judges to arrange the five entena ‘yP<=d c" 
along a yardstick with the distances between cards to 

in degree of awareness. Five ” “"and'^Oie^following scores 

mvolved in dissertation research served as j g ^divided bv 

represent the median yardstick points assigned to each entenon (divided by 

three). 


Score 

0 

3 


Criteria for Scoring Ay-'orenea 
Criterion 

fghp“estmCr:« 

alizations connect it with a specific 

enlioncd the remforccmenl. but cia no 
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2 Immediately after this experiment is over, you will be asked the purpose 
of this experiment, i e , what is really going on See how perceptive you can be 
in determining the true intent of this experiment 

Now I will show you a series of photographs For each one I want you to 
judge whether the person pictured has been experiencing success or failure To 
help you make more exact judgments you are to use this rating scale As you 
can see, the scale runs from —10 to +10 A rating of —10 means that you 
judge the person to have experienced extreme failure A rating of +10 means 
that you judge the person to have experienced extreme success A rating of —1 
means that you judge the person to have experienced mild failure, while a rating 
of +1 means that you judge the person to have experienced mild success You 
are to rate each photo as accurately as you can Just tell me the rating you 
assign to each photo All ready'’ Here is the first photo (No further explana- 
tion may be given, although all or part of the instructions may be repeated ) 


The instructions given the expenmenters earned one of the treatment 
^mensions Half were led to expect that their subjects would subsequently 
be aware of having been conditioned, and half were led to believe that their 
su jects would not be aware The instructions read to subjects by their 
experimenter were designed so that half the subjects would view it as a 
performance to be aware of having been conditioned, and 
half the subjects would not be given such a set 

subjects had been contacted by their experimenter they were 
wa« be filled out m succession The first questionnaire 

two use by Matarazzo, Saslow, and Pareis (1960) It asked simply 
evidfnt'c purpose of this expenment was ” and (2) “My 

answers to ^ /V About a half page of space was provided for the 
agree questions Ome (1962) has suggeLd that subjects 

of the exnerment^ ignorance” to not ‘ see through” the ostensible purposes 
supnorts^this v ^^penence of the research program under discussion 

mlCfor suw. that a very vague, general 

awareness, would be favoTabTeToT*'* incentives offered for reports of 

An inauirv that ^ awareness among the subjects 

been smns on m th suggestions to subjects about what may have 

vided by the auestions tn I* probably due not so much to the cues pro 
probably, is the general ^ important, 

perform'a’nce ITa 'ot rhu' r "'“i 

se:.“n;r“ ■' P™‘ "Vform:Trquil"rat 

chosen'l^ehcttlirr” a™ S2,T.sts 

2 For half of the subjects the senteno* w 

test, was substituted for this paragraph^ process of standardizing a 
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Treatment effects. Tables 11-1 and 11-2 show the percentage of the 
average experimenter’s subjects within each experimental condition who 

TABLE 11-1 


Percentage of Subjects Judged Aware: Question- 
naire 1 


EXPERIMENTER'S 

EXPECTANCY 


SUBJECT'S 

SET 



Awareness 

Nonawareness 

Means 

Awareness 

31 

13 

23 

Monawareness 

24 

10 

14 

Means 

28 

n 

19 


were judged aware by Q1 and Q2 Analysis of the data from both question- 
naires showed that experimenters expeeung their subjects to be a^re 
obtained higher rates of awareness than did expenmenters 

S to eTst between ihe conditions where “penmenter expeemn^ 
subject set were both favorable to 2 46) 

where both were unfavorable to awareness (p = 

What we do not know, but what must be learned, is how an experi 


TABLE 11-2 


Percentage of Subjects Judged Aware: Question- 
naire 2 

EXPERIMENTER'S 

expectancy 




Awareness 

Nonawareness 

Means 

SUBJECT'S 

Awareness 

78 

55 

40 

47 

62 

50 

SET 

Nonawareness 



Means 

68 

43 

56 
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class of ratings, or 5 brought up the possibility of certain ratings being 
reinforced (including the correct response class), but in conjunction 
with other incorrect hypotheses 

6 S stated that some specific class of ratings was being reinforced, but 
names the wrong response class, or he slates the correct response class 
but does so along with an incorrect hypothesis 

10 S correctly stated the specific response class being reinforced, and did 
not state an incorrect hypothesis in addition 

12 S correctly stated the specific response class being reinforced, stated no 
incorrect hypothesis, and correctly differentiated 5ie use of "good ’ from 
the use of “excellent ’ as remforcers 


Reliability of scoring was nearly perfect for questionnaire number one 
(r = 99), and adequate for questionnaire number two (r= 87) Both 
correlations were based on an N of 63 subjects who completed the question- 
naires The two subjects who did not complete the questionnaires were 
excused when they began using terms like "contingency” and all but argued 
t e ments of open-ended versus structured interviews to lap awareness' As it 
eveloped, both had run a verbal conditioning study of their own the preced- 
tng semester as part of an undergraduate research program As far as 
cou e determined, there were no more than these two sophisticates 

n a cases where the two scorers’ ratings of a questionnaire differed, 
e mean o the two ratings was the final score assigned that questionnaire 


Questionnaire number two (02) evoked much 
oemeat^If^T^u Snestionnaire number one (01) On 01, 70 

percent turned awareness scores of zero while on 02 only 2 

er’s Suhipnt!'^ On 01, 19 percent of the average experiment- 

cent earned scores of 8 or higher, whereas on 02, 56 per- 

awareness srnrp subjects, 78 percent earned a different 

scored more aw "''5' ’’U'* °n 01, and 100 percent of these 

scored more aware on Q2 (binomial p less than 00001 ) 

awareness 01 ^ 01 "°"^ between experimenters’ obtained rate of 
cTe at on (onCta.l p = 01. di = 16) The 

+ 50 (p < OMl) Q2 awareness scores was 

the dlshib'^irn tat mtke21r“^^ '"’’"a 

that for nnnt.pni ^ discontinuous and asymmetrical, suggested 

a ffvItom !cat'^7°*': -- => two-pomt mthS than 

defined^as aware if hi7aUSss7'' 

Chosen because it represented theT T 

scores on Q1 ^ the lower limit of the upper distribution of 
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significantly less likely to make the desired responses when he has been 
given a set to “see through” an expenmentai procedure The set to “see 
through” may well carry an implication of “don’t go along ” 

The question of whether any of the groups showed verbal conditioning 
must remain unanswered All groups showed similar acquisition curves, 
but this may have been due, in part, to a photo order effect An earher 
study showed that experimenters biased to expect negative data a so 
obtained linear acquisition curves of positive ratings (Rosenthal, o e, 
Vikan-Kline, S. Persingcr, 1964) 


THE PHENOMENOLOGY OF THE SUBJECT 

Riecken stated that one of the experimental subject’s major aims m 
the experiment is to “penetrate the experimenter’s inscrutability and dis- 
cover ^hTTationale of 'the experiment” (1962 ) Even a --ry rea mg 
of the 60 questionnaires (Q1 and 02 eombined) confirms this 
After more careful study, each of the 60 questionnaires was assigned to 
one of the following three categories (1) Subject stated that the purpose 

svj 5.. » 

wt4 or without mentioning standardization Jtay to 

group 1 , whCTOus 42 uboul iho rotionidu of rho orpen- 

two out of five subjects held hypo narticular study but which sampled 
ment which had little to do with t p „s„areh psychologists might 
fairly well the kind of thing that con were 'being assessed for 

very well be after Several subje j® -..y Several hypothesized that 

degree of prejudice based on the fact that 

we were measuring ‘heir degre F J common hunch was 

one of the photos was «> designed to tap every- 
that the pictures were really P pessimism This finding lends 

thing from self-concepts to op ^ ats tend to see the psychologist- 

support to Riecken’sformulaPon^^^^^^^^ (IP, 2) 

researcher as a “poker and a p y formulating hypotheses. 

All in all, subjects were quite ^ h level of sophistication 

some of which would imply J ® aware a number made specific 

Whereas on 02 most One subject, who had not 

reference to their handling experimenter was trying to 

been rated as aware, said sn a rigorous 

get her to change her ratings but she Knew 
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menter who expects awareness from his subjects treats them compared 
to the way an experimenter who does not expect awareness treats his 
subjects Perhaps experimenters expecting their subjects to be aware are 
less subtle m their reinforcement of subjects’ responses Perhaps, too, they 
convey a conspiratorial impression of ‘*we both know what’s going on 
here ” Such an attitude may legitimate the subject’s subsequent verbali- 
zation of what he knows 

In order to determine the effect of experimenters’ reinforcement of 
higher ratings, it was necessary to employ an additional control group of 
experimenters which, like the experimental groups, expected high photo 
ratings but, unlike the expenmental groups, was not programmed to 
reinforce them Four additional expenmenters, drawn from the same 
class as the other experimenters, were accordingly led simply to expect 
high photo ratings These expenmenters contacted a total of 26 subjects 

TABLE n— 3 


Mean Photo Ratings 


EXPER^ENTER'S 

EXPECTANCY 


SUBJECT’S 

SET 



Aworeness 

Nonoworeness 

Meons 

Aworeness 

58 

63 

60 

Nonaworeness 

1 24 

1 20 

1 22 

Means 

91 

92 

91 


drawn Th^ e Same class from which the other subjects had been 
Table given no set to see through” the expenment 

the four exn photo ratings obtained by experimenters in 

f obtaiLd by experi- 

Those subjects given a set to 
from tho.e^^v t photo ratings thi were no different 

cZv lowef r It ^^°“P T^y were, however, sigmfi- 

the control ornf All experimental groups and 

Dositivr minlrflll " l-near eul^es of aequis.tmn of 

P g , all having about the same slope (35 degrees) Degree of 

7Z"Z:: be^nrelted^ploto mtings 

fware If Lm h "'taher or not a subject may be judged 

aware of having been verbally reinforced for a eertiin response, he is 
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recent illustration. The research was in the area of dreaming responses. 
There were 10 volunteer subjects who were wakened and asked to report 
their dreams whenever their eye movements suggested to the monitors 
that dreaming might be going on. About one third of the dreams dealt 
overtly with the experimental situation, about one third dealt covertly with 
the experimental situation, and about one third did not appear to deal 
at all with the experimental situation. There was the predictable evaluation 
apprehension Rosenberg has described (1965) and a great variety of 
emotionally significant reactions to the experimenter. Female subjects tended 
to view him as more seductive, males as more sadistic. Some dreams found 
him incompetent; some found him potentially therapeutic but not help- 
fully motivated; some found him a cold, exploiting scientist, or even quite 
unscrupulous. This more clinical research may evoke stronger reactions to 
the experimenter, but from the evidence presented earlier we must con- 
clude that such reactions may also occur in less psychodynamically loaded 
interactions, though perhaps to a lesser degree. 


SOME RECAPITULATION AND DISCUSSION 

The data suggest that in studies of verbal conditioning concerned 
with the role of awfreness, the experimenter’s expectancy of 
significantly affect the rates of awareness he wiU 

jects’ perceied demand characteristics of the “ fS 

to play a role in the determination of subsequent "f 

to a smaUer and less i^bld awareness rates, 

for awareness makes a significant oiifer subiects 

However, when an experimenter expects “S 

at the same time that his subjects have a positive ^ _ 

the experiment, he tends to obtain ^er ^ 

jects than when the none of the obtained p levels 

of inquiry employed in this ® Thus on Ql, three times 

was striking, the magnitude of the 

as many subjects of „ nitude of effect may have been 

opposite treatment condition. This g difficultv in the experi- 

e^e'n greater had it not been for “jf^Sitstand^iT condition Lre 
mental procedure. Many of ‘h® out the questionnaires. It 

able to see some charLteristies among 

seems Ukely that this might have e attentiveness and seeing 

the standard set '"^t’^red^Sm the subjects’ prospect of 

through, sets reasonab^ to be e p p„cedure. 

having to answer questions about t P hal conditioning, 

Krasner (1958) in ^ 

found that over one half oi ineiu 
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Standardization situation, this could not possibly be the case One clearly 
aware subject manifested unmistakable signs of guilt over ruining the 
study through her being aware, while several mentioned the contingency 
and their decision to go along or not go along 

Perhaps the most stnking illustration of the complexity of the problem 
of our penetrating the subjects inscrutability came from a questionnaire 
which m reply to Q1 stated “The purpose of this experiment was to stand- 
ardize a test They used a standardized rating scale and the person 
admimstrating [sic] the test was not allowed to say anything This kept 
his influence out The fact that we all make our judgment on the pictures 
would give returns which would show the standardization of them ” Not 
five seconds later this same subject on Q2 replied to the same question about 
the purpose of the experiment “To see how much the words given by the 
tester influenced me ” 


In this study the experimenter-subject interactions lasted as little 
as five minutes This seems to be an unusually short period for the 
development of “transference” reactions toward an experimenter Never- 
theless, one of our subjects made very clear reference to the sexual 
implications of being alone with an experimenter m a small room and 
desenbed some of her experimenter’s characteristics in inordinate detail 
Even if such responses were quite rare, they would nevertheless serve to 
remind us that subjects are far from being the automated data production 
umts that Riecken (1962) has suggested is a frequent current view of the 
subject But such ‘ transference” reactions are not all that rare In the 
researc program under discussion one or two such responses are obtained 
in every experiment This is the more remarkable not only for the brevity 
o the experimenter-subject interaction but also because there is very 
acquainted possible The tasks chosen for this research pro- 
designed to minimize expenmenter-subject inter- 
mipht mnr difficult to get the unintentional influencing we 

actioni nr ^ ^ cxpect m more elaborate expenmenter-subject inter- 

actions or in clinical interactions 

construction verbal conditioning employing a more standard sentence- 
intere d further evidence that subjects are sometimes 

ircmtabfc I “ => than simply as an 

1966) Inthatstu'Setenrofr't"'’ ^ 

or more niivcmoi ^ ^ subjects made some reference to one 

v“o -P<=nmen,er wh.ch were “.rrele- 

the exnenmenfer’Q n "f ” * T ^ Performance References were made to 

condition, and relat.ve“Lma«rve°it? *"131 

“transferenc^’^ clinical we expect more of the 

(mS hard/n and we get them Klein 

(1956) has discussed this problem, and Whitman (1963) gives a more 
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two experiments, although frequently wrong for these particular studies, 
were uncomfortably accurate in assessing the kinds of research in which 
contemporary psychologists were likely to ask them to participate The 
day of the naive sophomore may rapidly be drawing to a close 


CONFLICTING EXPECTATIONS 

In an experiment by C R White (1962), the expectations of the 
expenmenters were vaned as m other studies, but subjects were given 
varying expectations about the stimuli they would be asked to judge His 
expenLnters were 18 graduate students in counseling and ^ 

his^ subjects were 108 undergraduates enrolled m b^ 

In earher studies in this research program there had always been 
only two expectancies Thus, when the task was that of ]“dg>ng 
cess or failure of persons pictured in photos, half the ^ 

led to expect success ratings and halt were led to expect f 

White hLever, employed six different expectances, to each of which 
three ^perimenlers were assigned at random These six expec^^^^^^^^ 
not single numbers but rather a set_of -erIapp.ng^anges_of e^^^ , 

the means of which were —6, —3, 0 5,+ » ^ divided into 

of these conditions of experimenter expectancy, J induced 

SIX groups, each with one of the expectancies 
in the expenmenters These expectancies were y 

that the particular photos +3, +6) The sue 

to evoke ratings of about —6 (or , j conditions of subject 

conditions of expenmenter expectancy, vanance design 

expectancy, were analyzed by means of a 6 X 

(p = 001) between expenmenters “"d su J J positive 

shows the mean ratings obtained by e p ^sj^ive or negative ratings 

or negative ratings for subjects “^om e 

had been suggested The d^a supp S^^jects predisposed to rate 

(Helson, 1964, Sherif & Hovland 1961 ) ^ 1 

low, when contacted by n’TS" gting a kind of opinion entrench- 

gave the lowest ratings (p — "it, 66 e con- 

ment Similarly, when subjects were giv the highest 

fronted by e/penmenters expecting <>« ra "gs. th^^J^ 

ratings, though this '^"^‘"8 ^“ava.labfe for this further analysis In 
White kindly made his d contacted by 

addition to the ‘ entrenchmen . _ another factor was found to 

expenmenters with contrasting exp interaction effect Table 11-5 shows 
contribute to our understanding of discrepancy between 

quartiles of subjects arranged i 
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of any subject In all these studies, only 5 percent of all subjects were reported 
to be aware In the present study, even on the crude Q1 19 percent of the 
subjects were aware, and on Q2 about 56 percent were aware The reason 
for this discrepancy is not entirely clear The possibility that all our 
subjects had perceived the demand characteristics as generally favorable 
to awareness cannot be ruled out Communication among subjects was 
possible and likely, but this is probably true for most verbal conditioning 
studies (and other studies as well, though it is rare to find the problem 
taken seriously) In addition, it must be admitted that the author’s ex- 
pectation was for a high rate of awareness, and although it was possible 
to remain blind for membership m treatment conditions, subjects did have 
to be contacted by members of the research group, however briefly, so that 
they could be directed to the proper laboratory rooms and, later, have the 
questionnaires administered 

In another verbal conditioning experiment, the one employing a 
sentence construction task, the rates of awareness obtained were somewhat 
lower (Rosenthal, Kohn, Greenfield, & Carota, 1966) In that study 17 
percent of the subjects were clearly aware, 8 percent were somewhat 
aware, and 75 percent were clearly unaware In this expenment, as m 
the one described in detail, several aware subjects noted their difficulty 
m trying to decide whether to go along with the experimenter’s attempt to 
intiuence their response Subjects can sometimes verbalize their deutero- 
problem very well 


. ® answers to an awareness questionnaire whether 

urti Ji! aware during the expenment We cannot tell 

‘f unaware,” is responding as unaware because he 
n erpjili '' to do There is a kind of subject especially 

who h ^ doing the proper thing, and that is the subject 

fCrownp 1 Marlowe Crowne Scale of Social Desirabihty 

construcfon expenment, 
fr— -jn ^ significantly less aware responses 

p~lQ^rLZ subjects (r = - 22, 

for acnrovni mo ^^*ous subjects and those higher in the need 

permits no '‘seeing^tVrouT’ '’rhaf th''^ 

expenmenter m nOi ^ show their desire to please the 

m need to approval arnve earlier at the site of the experiment (r = + 40 


of thi^^Vcond 'stuVy questionnaires 

of intomatinn ti, c - “"‘''Zoning yielded much the same sort 

*:ro",emd to^Ri »■=>-<= f 

cvctemotie * . r (1962) was Tight to call for a more 

The Cs 3 h™ n ' P““P‘“ns of experimental sttuat.ons 

The kinds of hunches subjects had about the [rue purposes of the 
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istics of the experimental situation (Orne, 1962). The examination of 
such joint effects is only just now being mapped out for inquiry. But from 
what data there are, both quantitative and qualitative, the conclusion seems 
warranted that what is in the head of the subject and in the head of the 
experimenter can unintentionally affect the results of psychological re^ 
search. 
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TABLE 11-4 


Mean Photo Ratings as a Function of Experimenter 
and Subject Expectancies 


EXPERIMENTER'S 

EXPECTANCY 




Positive 

Negative 

Means 

SUBJECT'S 

Positive 

59 

81 

70 

expectancy 

Negofive 

-43 

42 

00 


Meons 

08 

62 

35 


their own expectancy and their experimenter’s expectancy The correlation 
between discrepancy of expectations and mean photo rating was — 96 
(p = 05) Regardless of the direction of experimenters’ and subjects’ 
expectations, subjects tended to rate the photos as more successful when 
I eir expectancy and that of their experimenter were m greater accord It 
inay be that when experimenters and subjects had similar expectancies, 
t eir experimental interaction was a smoother, more pleasant experience, 
with less conflict for the subject over whether to be influenced by the 
investigator who had induced the subject’s expectancy or to be influenced 
y the subtle cues of his own expenmenter The lack of conflict may have 
cjn rellecied in his perceiving others more cordially— i e , as more sue- 


tend Tillf ■" •*’“ served m part to ex 

DarticiihHuTh”' ' t vflecls of the experimenter s expectancy More 

cXDCctancvi combined effects of the expenmenter’s 

P y and the subject’s set or his perception of the demand character- 


TABLE n— 5 


Mean Ratings as a Function of Discrepancy Between 
Experimenters' and Subjects' Expectancies 


Quartiles 

1 

2 

3 

4 


Mean Discrepancy 

92 

53 

27 

03 


Aleon Rating 

35 

43 

50 

59 
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of finding expected data and surprise at obtaining unexpected data and 
continued by stating that where “average values” were obtained ’“'‘ally, 
subsequent data would tend also to be of average ^ 

“especially large or small numbers are expected it would tend to further 

.. h« « Ml 

and subject Nevertheless, on the basis of hU thinking o the reaso^ng 
described earlier, it was decided to test Ebb.nghaus hypoftesis of the effect 
of early data returns on data subsequently obtained by 
There was also an interest in learning whether the “P” 

would have a greater biasing effect upon their “ neTfinding 

their male subjects. This seemed reasonable in view ° *c f "er^ 
in the literature that female subjects are more ^cts of 

influence processes. Finally, there was nterest in ^b^ ^ 

early data'retums would operate — ^ rubjects 

contacted by experimenters or whether earli 
would be more affected. 


THE EFFECTS OF EARLY RETURNS 

The experiment has been 12 male 

thal, Persinger, Vikan-Klme, & Fode, p^rimenters. The subjects were 
graduate students in education to serve ^conhomores, enrolled in be- 

55 undergraduates, mostly freshmen About half were males and 

ginning courses in psychology and e u investigating some 

half were females. In this expenm ’ . expectancy, it was de- 
factors complicating the effects of t e e pe ■ -pg] studies demonstrat- 

cided that the same task as that emp oye purpose of these studies 

ing expectancy effects should be use . learn more about the 

wfs not simply to replicate the bas'^ the studies were 

variables affecting the operation o t emnloyed. 

kept comparable with respect to t e experimenter presented to each 

In tL present study, ‘harefore. photos of faces 

of his subjects individually the ® hoto on the apparent success or 

and asked that the subject rate eac p ^ j.jj„pi„g. Subjects were to 
faUure that the person pictured had ^^he their judgments, 

use the rating scale descnbed ear experimenter was individually 

Before contacting his f“b]ects experimental procedure. The exact 
instructed and briefly trained as .—.opraphed and given to the expen- 
instructions to experimenters were J™ | session. These instructions, as 
menter when he came in for his °d ,o his subjects, were 

well as the instructions each expenmenter 
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In the last few chapters the effects of the experimenter’s expectancy on 
his subjects’ responses have been considered In the present chapter, to 
some extent, we reverse the direction of the predictions and consider 
me effects of the subjects’ responses on the experimenter’s expectancy 
cept in the most exploratory of experimental enterpnses, the expenment- 
Th likely to be based upon some sort of observed data 

These data need not have been formally acquired They may derive from 
quite ca^al observations of behavior made by the experimenter himself 
or even by another observer Since some sort of data are the most likely 
cxpenmenter expectancies, we may fairly ask what about 
e data obtained early m an experiment’ What are their effects upon data 
^ 0 tamed within the same experiment’ Perhaps early data 
inH ™ expenmenter’s hypothesis strengthen the expectancy 

firmatnr^ hkely that subsequent data will also be con- 

exDecti?nv returns that disconfirm the expenmenter’s 

disconfirtmnJH expectancy in the direction of the 

data Will rn^t ^ ^ ° twined, thereby making it more likely that subsequent 
Iscdh “tr “‘S'™' hypo.hes./but supped .he 

an effect nn returns of psychological research studies can have 

by EbbinghaurnssTr 

of their studies -ic tu saying that investigators notice the results 

able that after the "Consequently it is unavoid- 

should a nse . n o ‘he numencal resuUs, suppositions 

occasionally give E^as^^toTh^” concealed in them and which 

ned further tho« presence As the investigations are car- 

cons,r.o a folho';'’'’"';™*’ “ afthe beg.nn.ng 

upon the subseqaLtre”u\s”‘'(p 2 ' 8 ’rH'’™’’“’’‘^ influence 

T (p 28) He went on to speak of the pleasure 
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Mean Photo Ratings 


Treatment 

Experimenter 

Pretest Subjects 

Test Subjects 


El 

3.68 

0.51 


E2 

3.45 

1.19 

“Good 

data” 

E3 

E4 

2.03 

1.90 

0.83 

0.68 


Mean 

2.77 

0.80 

Control 

ES 

E6 

Ey 

E8 

1.30 

0.43 

0.18 

-0.70 

1.24 

0.80 

0.34 

-0.06 


Meon 

0.30 

0.58 

“Bad 

E9 

ElO 

Ell 

-2.38 

-3.08 

-3.83 

4 no 

0.16 

0.55 

-0.09 

0.10 

data" 

E12 

— 4.00 


Mean 

-3.42 

0.18 


they had been instructed, the -atments were conside.d adequate, since 

none of the groups’ pretest ® j variance of the means of the 

Table 12-2 experimenters from his four test 

mean ratings obtained by each 


TABLE 12-2 


Analysis of Variance 


of Mean Photo Ratings 


Source 

Early returns 
Linear regression 
Deviotion 
Error 


(0.4324) (2.74) 

0.7750 4.91 

0.0898 
0.1577 


dl 
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Similar to those presented in earlier chapters It should be noted that 
the investigator who instructed the expenmenters did not know into which 
treatment group any experimenter would be assigned 

The overall design of the experiment was to randomly establish three 
groups of four expenmenters each, all with a bias, expectation, or hypothesis 
to obtain high positive ratings from their subjects For one group of expen- 
menters this bias, expectation, or hypothesis was to be confirmed by their 
first two pretest (“good data”) subjects For a second group this bias, ex- 
pectation, or hypothesis was to be disconfirmed by their first two subjects 
(“bad data”) The third group of experimenters was to serve as a control 
group (“normal data”) 


The first group to be run was the control group of four expenmenters, 
each of whom contacted six naive subjects Of those eight subjects who 
were run as the pretest subjects by the control expenmenters, four were 
selected on the basis of their having free time when the remaining experi- 
menters were to contact their subjects These four subjects agreed to 
serve as accomplices and were instructed to give average ratings of +5 
“good data” expenmenters and —5 for the 
>* expenmenters Each of the accomplices then gave “good 
a 0 two experimenters and “bad data” to two expenmenters Accom- 
p ces appeared equally often as the first-run and second-run subject 

^ rreatment groups of experimenters were thus defined the “good 
S^®^P experimenters each contacted two accomplices who gave them 
‘’J’ were naive The “bad 

them expenmenters each contacted two accomplices who gave 

naive expected, loUowed by four subjects who were 

SIX naive group, expenmenters each contacted 

photo ratinJ o * ^ dependent vanable was defined as the mean of the 
menter in eLh^^'a ^ subjects contacted by each expen- 

Was hv;o,ret dt were, of course, na.ve, and .t 

rhou,&“f “P«"-nce of having obtained “good data” 

to expenen^ experimenters to obtain “better” subsequent data, whereas 
ers to obtain o tamed "bad data” should lead those expenment- 

menters with the neLsar’v re • randomly assigned to expen- 

expenmenters' available free tm ^“"1® 

three test subjects instead of tour “ experimenter contacted only 


TVeatment effects. Table 1 9 i cu 

expenmenter and each treatment rating obtained by eacf 

and their lour test subjects For t£. 

two pretest subjects w^ of ” and “bad’ data groups th< 

the pairs of accomplices actuallv o ’ ^ “^compliees Although none o. 
F ccomplices actually gave mean ratings of either +5 or -5 at 
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TABLE 12-4 


Mean Photo Ratings by First and Last Two Test 
Subjects 

Treatment First Suhiects Last Subjects Difference 
“Good data” 0 58 1 02 0 44 


Control 
“Bad data” 


0 57 
0 47 


0 59 
-0 12 


0 02 
-0 59 


Further support for a hypothesis of a “delayed action effect” can 
be seen m the sequence of correlations between the mean pretest 
the ratings obtauied from the first-run test subjects, then t ® ’ 

and fourth-run test subjects This sequence of correlations the 

— 07 43 41 The last two correlaUons were significantly higher 

first two (p = 02, two-tml, r = 8 20, 4/ = 2) Thus, 

m order, it appears that the later-contacted subjects accou 

the correlation found overall and reported ne.t T^e “aelat on (rho) 

between the data that experimenters obtained from i ^ 

jects and that obtained from all_ four ‘ ,d,„j.eal with 

Jh^enrdl iTa l“m fLoZ group -per.rnen..s arc^ 

The effect of “early returns” of data, then, '"^n j 

account for up to 47 percent of the variance of the data obtained from 

'"'"xrE'o. .1. 

the first-run pretest subject alone, and the secon lu p 
analogous correlations were ®''^“[^ quently obtained from his 

experimenter and the data that 'ho obtained was 

four test subjects For the first-run Pru'“' 

-1-55, (p< 05), whereas for 'he 

-f 74, (p < 01) The difference between thes of 

staustical significance, and ^ by adding more early re- 

“good" or “bad” early returns «h“™ , ^ s^ibilny that the data 
turns What is of real interest, hmvc , subsequently ob- 

from only one subject may have ,„„on, must be tempered 

tamed data This interpretation, or ra H subjects 

by the fact that all experimenters i ^uight have been quite 

and that the effect on subsequent t J_nIo\ed 

different had only one pretest ®“h)”‘ “ui^spretation of these obtained 
One other factor cutuP'"" “ * airecunc subsequcnily obtained 
correlations Rather than the early re lu,. of his personality and 

data, it may be that the experimenter, y 
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subjects The obtained F of 4 91 for linear regression was significant beyond 
the 03 level (one-tail), the ordenng of means having been predicted 
The difference between the means of the two expenmental groups was 
significant at the 01 level (one-tail, t = 3 \A, df — 6) 

Sex effects. Table 12-3 shows the mean obtained ratings, considenng 
male and female subjects separately within treatments The grand mean 
rating by males of -f 49 did not differ from the grand mean rating by fe- 

TABLE 12-3 


Mean Photo Ratings by Sex of Subject 


Treot men! 

"Good data" 
Control 
"Bad data" 


Mo/e Sub/ects 

61 

.52 

35 


Female Sub/ec#5 

.99 

62 

.08 


ni es 0 -f- 56 Inspection of the treatment means suggests that the 
reatment effect may have been more powerful m its action upon female 
an upon male subjects The differences between the means of the control 

than for the male 

well r-.r ^ P = 10, two tail) The remaining analyses 

that ih. ™ female subjects combined, since it was found 

Dronorfmn^i of subjects to experimenters had resulted in a 

fln^a siiha^ *stnbution tor both treatments and order of test subjects 
subiect cha^'^^t" ^ dealing with expectancy effects as a function of 
subjeltT) ' ®f O'® 


retur^I^^shnl^^?’ determine whether the effects of “earl 

compared to the mean S the*^'’ subjects wt 

though these trends were not v *1“ 

t = 542 df=n ‘ staustically (p = 13 , two-tai 

arouD shower! a me ^ ““tmE Whereas the contri 

showed a mean rat.ng"chan« of -fs”' f Z t 
shift of + 44, suggesting fhat the^’ff 

marked later in thf process of 

onlv the firct of tmo tic* c u S®*henng subsequent data After having ru 
ferent from earh nth ^ obtained ratings were barely dil 

(Table m) <he predicted direction 
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explained'’ When the early returns of an expenment are “good,” the 
hypothesis with whieh the expenmenter undertook the study is partially 
confirmed in his own mind and thereby strengthened, with a possible 
increase m the biasing phenomenon for subsequent subjects 'ne experi- 
menter’s mood may also be considerably brightened (Carlsmith & Aronson. 
1963), and this might lead him to be seen as a more ‘ likable, 
and “interested” person in his interaction with subsequent subjects There 
IS some evidence, to be presented in subsequent chapters, which suggests tha 
such expenmenter behLor increases the effects of his expectancy on h.s 

subjects’msponse^^ of incoming data - -ndeed effect changes m an 
expenmenter’s mood has been suggested by Wdson (195p and ^ 
beL recently, charmingly, and autob.ograplucal^ ‘’“TdTcla.ed^itSff to 

(1961) Hetoldhow as the dam came m Each rec^^ 

“tofaTdoes thf glmbler’sthose JckVe^.y «P-es to him a 
m ^bose eady returns are «y 

be simtlarly analyzed, although to situation^m^y^ ^ experimenter as 
this case If the “bad early returns P mood change mak- 

disconfirmation of his hypothesis, h ,erested ” thereby possibly de- 

ing him less “likable,” ‘‘P-^°-'; efperim'enlr It may 

creasing his effectiveness as an exp ^ mturns form the 

also be that for some experimenter t obtained from 

basis for a revised hypothesis, confirmation of which 
subsequently contacted subjects 


A SECOND STUDY OF 
EFFECTS OF EARLY RETURNS 

Essentially, ton, "lajor vanables^l«ve^b^^^^ ^^P 

us understand the effects of early _ affective one has been 

has been called “hypothesis confirmauo , expenmenter 

called “mood ” It was suggeste joes not imply hypothesis con- 

mood change, but, of course, mo g expenment reported now was 

firmation or disconfirmation Intetes returns effect which could 

in the relative proportion of variance of the early 

be asenbed to the operation of moo a chapter, data ^'crc defined 

In the first expenment ^cportc success of the persons 

as “good” if they represente ugh j^pmition of ‘ good,” or cxpc'"-^ 
pictured in the photos In order photos, the nature of the 

data not be equated with higher ra ungs ^^^^^1 axpen- 

imtial expectancy was also vane 
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technique m a given situation, tends to elicit similar responses from all 
his subjects, thus tending to inflate the obtained correlations This possibility 
IS most obvious for the control group experimenters who contacted only 
naive subjects from the very beginning However, it is also possible that 
the experimenter affects even the accomplices in a systematic way Table 
12-1 shows that there was considerable vanabihty in the ways in which 
the accomphces were able to comply with the request to give -t-5 or —5 
ratings to their expenmenters Whether the accomplice-within-treatments 
vanabihty was due to initial accomplice variance, effect-of-expenmenter 
variance, or an interaction variance remains an interesting question subject 
to further study At any rate, this question does make any simple inter- 
pretation of the obtained correlations tenuous 

Examination of the rank correlation between pretest and test data for the 
control group alone shows it to be unity In addition, the first-run pretest 
subject means correlated perfectly with the second-run pretest subject 
means We are faced with the same difficulty in interpretation was it 
expenmenter effect or subject effect‘d Thus, although these subjects were 
not accomplices, their ratings may have served to give the experimenter 
hypotheses which he then went on to confirm 


SOME RECAPITULATION AND DISCUSSION 

The data suggest that Ebbinghaus’ hypothesis — that early data returns 
can ect subsequently obtained data — was correct not only in the situation 

Where the expenmenter serves as his own subject as Ebbinghaus ongmally 
ormu ate it, but also in the situation m which the experimenter is 
contacting others as his subjects When the first one or two subjects give 
^ ®^pscted data, data obtained from subsequently contacted sub- 
‘ h!»fi’ ^ ^ 8^0*^ ’ When the first one or two subjects give 

he- “hriH ” data from subsequent subjects tends also to 

that th^ expenmenters employed m this study, it appears 

than iinnn ° ^ returns may operate more powerfully upon female 

earlv rpf ^ possibility was also suggested that the effect of 

S m V h. T ™n.ed.ately Apparent, but that the 

Thp^finH ^ cumulated to somewhat later-contacted subjects 

ratine rn, M variance of the test subjects’ photo 

rS Z In, “ knowledge of the pretest subjects’ 

ooZu o? thTs -‘“P'ot It nught well be that some 

Ze Ld o«oot of early returns and some to 

reZenr?, ns h.s personahty X technique 

smlrlvZ K "’'"“•■on which effects might L distributed 

^ ‘ko expenmenter 

g e e ects of early data returns on subsequent data be 
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that Obviously, you’ve run subjects before this Well, keep up the good work 
with the rest of them See you later 

In the reproof conditions, the cntic entered, picked up the expenment- 
er’s data sheets, studied them with a wnnkled brow for about thirty seconds, 
began to frown, and then said approximately the following 

Your data certainly follow a strange pattern Haven’t seen results 
in a long time I’d tell you more specifically what bothers me except that 
wouldn“\e really crickef to do that now-perhaps 
must be doing something strange to draw data patterns Ijke ‘ 

you’ve run subjects before this Maybe empirical research is not your cup 
Wl, please try to be very careful for the rest of them See you later 

Then each experimenter contacted from three to *«2txnenS 
m succession After they had completed P° ^ ^ J 

experimenters who had been reproved were told that they really had done 

Combmation of the four variables described f 

initial expectancy, (2) "reproot W 1 

“good” or “bad” early returns), (3) pra .a ,n -i v 2 y 2 X 2 

cLc 2-yielded 16 experimental conditions (arranged in a 2 X 2 X 2 X 

factonal design) research rooms were randomly 

what the treatment conditions of the experi carrying out their 

blind as to the particular conditions in which they were carry g 

praise or reproof 

Effects of early returns. Table 12-5 +^5 ratings 

defined as the differLe between data obtained when expecting -h 

table 12-5 


Mean F 
Returns 


Photo Ratings by Initial Expectancy and Early 


Expectancy 


-GoodDato" -Bad Dale" 


Difference 


+0.78 


-0 34 
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menters were thus led to expect +5 (success) ratings, as in the earlier 
study, but half the expenmenters were led this time to expect —5 (failure) 
ratings from their subjects 

Hypothesis confirmation or disconfirmation was again varied by the 
use of accomplices serving as the first two subjects These accomplices gave 
data either in accord with or opposite to the experimenters’ expectancy or 
hypothesis 

Mood or hedonic tone was experimentally varied by having one of 
the investigators praise or reprove experimenters for their technique of 
“running subjects” after the accomplices had performed the expenmental 
task but before the “real” subjects had been through the procedure Praise 
was designed to induce a good mood in expenmenters, reproof a bad mood 

The details of the expenment have been reported elsewhere (Rosen- 
thal, Kohn, Greenfield, & Carota, 1965) The experimenters were 26 
Harvard College seniors, all but one of whom was wnting an undergraduate 
thesis in the Department of Social Relations Expenmenters administered 
the photo-rating task to 115 female subjects, all of whom were enrolled 
as undergraduates in a college of elementary education Expenmenters were 
trained m the experimental procedures by an investigator who did not 
know to which experimental conditions expenmenters would be assigned 
The accomplices who served as the first two “subjects” were students 
at another women’s college and were selected on the basis of “trustworthi- 
ness That IS, they were well known to one of the investigators before the 
experiment began Twelve accomplices in all participated in the expenment, 
which was conducted on two evenings Eight were used each evening, and 
SIX participated both evenings Each accomplice served as “subject” for three 
or our expenmenters an evening Each was instructed to give photo ratings 
averaging as close to -fS or —5 as possible without using the same numbers 
suspiciously often In half the conditions these ratings confirmed the expect- 
induced in experimenters (“good” early returns) In the 
^ ^ ® accomplices’ ratings disconfirmed the initial expectancy 

( bad early returns) 

^ter expenmenters had contacted their first two subjects (accom- 

esK nnp ct tUo ♦„ J ' _ , 


plices), one of the two male 
expenmental room and either 


investigators serving as critics entered each 


T„ , praised or reproved the experimenter 
data f praise con itions, the cntic entered, picked up the experimenter’s 
leltTv , n then with an tn- 

following^ ^ ^>tpression, and, smiling, finally said approximately the 

m a f n'r n S”** 

that It wouldnt be LurcISet’to do^h‘^, ™ “Tm 

Qurp vnu miict ^ ‘ ^ do that now — perhaps later Anway, Im 

y e running things very competently to draw data patterns like 
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TABLE 12-6 


Correlations Between Early Returns and Subsequent 
Subjects' Responses 


Evaiuation 

Praise 

Praise 

Reproof 

Reproof 

Weigfitec/ mean 


Expectancy 

+5 

-5 

+5 

-5 


“Good Dato“ 

+ 67* 

+ 73 

+ 69* 

+ 999 

+ 96 


“Bod Doto” 

+ 88 
+ 06 
- 76 
+ 44 

+ 23 


♦ Four expe,.m=n.=rs per cell, all other cells hod three 
experimenters per cell 

expenmenters by their first 

of ratings subsequently obtained from re J , c i„ of the 

could be other Aan trivial in magnitude ‘"I, rceLpUces 

very restricted range of early A ^ { jourse been programmed 

within any of the deviation of the early data given 

to give the same responses The “^ 8 conditions was only 

expenmenters by the accomplices correlations only one was not positive 

0 5 Table 12-6 shows the obtained correhn^^^^^^^^ 

(binomial p < 04, 0"=-'“ ]f - 10) Inspection of Table 12-6 suggests 
4-79 ip= 002, one tail, / difference between those correla- 

that this overall correlation may masK opposed to discon- 

tions obtained when .c-.-s or cxpcctaUons When iniUal 

firming the experimenters’ initial hypo ^ 96 (p < 0005, one- 

expectancies were being confirmed t e me expectancies were being 

tail, df = 6) However, e^penmen^^^ s,g„,HcanUy greater than «ro 
disconfirmed, the mean r the mean r of 96 (z = 2 57, 

It was, however, significantly lower then whose initial cxpcc- 

p = 01, two-tail) At least "w data returns tended to obtain data 

tancies were confirmed by their y , data obtained from 

from subsequent subjects of an arnficial!) restricted range 

earlier contacted subjects, and this i p . factors ma) have been 

of early data returns However, two q personality factor or 

operating to bring this about ( ) , . factor were operant, expen- 

(2) an Lpeetancy factor U the .he samc\^a> in which 

mcniers would P*'' !/„a1 subjects Accomplices were, nfler a , 
they subscqucnllj affected thci 
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and when expecting —5 raUngs, were greater when the early data returns 
were “good” (p — 05, one-tail, /=171) and that they were smaller 
and in the wrong direction when early returns were “bad” (p > 50) 
Table 12-5 also shows an unexpected main effect on subjects’ ratings of the 
nature of the expenmenter’s early data returns Subjects tended to rate 
photos as being of more successful people when their expenmenter’s early 
returns were disconfirming This particular result has been discussed earlier 
m the chapter dealing with situational factors affecting subjects’ responses 
When the effects of early data returns were considered separately for those 
expenmenters contacted by cntic 1 and those contacted by cntic 2, a 
significant difference emerged For experimenters contacted by critic 1, 
the effects of early returns were marked, whereas for expenmenters con- 
tacted by cntic 2 there were no effects of early returns, only a tendency 
for all expenmenters to obtain data consistent with their initial expectancy 
The personality of the principal investigator who interacts with the expen- 
menter can, therefore, affect the relationship between eprly returns and sub- 
sequent subjects’ responses That the principal invesUgator can serve as 
a “moderator variable” (Marks, 1964) was suggested and discussed in 
the chapter dealing with situational influences on experimenter effects 

Effects of mood. Whether expenmenters were praised or reproved 
did not affect the magnitude of their expectancy effects, nor did it affect 
the magnitude of the early returns effect There was, however, an interaction 
between the effects of praise or reproof on expectancy effects as a func- 
hon of which of the two critics had contacted the experimenters (p = 10) 
Experimenters contacted by critic 1 showed greater expectancy effects 
when praised rather than reproved Expenmenters contacted by critic 2 
s owed greater expectancy effects when reproved rather than praised Such 
an interaction makes it virtually impossible to draw any conclusions about 
the effects of mood, as induced in this study, on experimenter expectancy 
ettects Who does the praising or reproving is more important than the fact 

Ot nraise or rpnrnr»f to r 


Early returns as sources of expectancy. When early returns con- 
Ti!*^ expectancies, expenmenters showed the greatest expectancy 
ere was also a tendency, when expectancies were disconfirmed, 
tills obtain data opposite to those expected initially From 
f ^ erred that the disconfirining early returns formed the basis 

,f This inference would have an increased plausibility 

a I, ^ early returns within treatment conditions often 
predicted the data subsequently obtained from real subjects Some relevant 
data are available from the study described 

Within each of the eight conditions shown in Table 12-6, a correlation 
(r) was computed between the magnitude of the mean ratings given the 
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determinants of subsequent data. There is a recent study by McFaU (1965) 
that is at least suggestive. Working in a different laboratory and at another 
university, McFall employed 14 experimenters to administer the photo- 
rating task to 56 subjects. (The particular photos employed were different 
from those employed in the earlier studies.) From half the subjects experi- 
menters were led to expect +5 ratings of success and from half they were 
led to expect —5 ratings. Within each condition of expenmenter expectancy 
half the subjects were given a set to respond to the stimulus photos with 
very fast responses. This set was induced by the use of conspwuous bimng 
derices, and it led to the eUmination of expectancy effects. McFaU reasoned 
that the greater the number of subjects who had this set for who 

were contacted by experimenters, the more disconfirming 
obtained. He therefore analyzed the effects of experimen er p y 
separately for two stages of the experiment differing in the amount of dis_ 
confirming data obtained. When a good deal of disconii^ing data tad 
been obtiined, experimenters showed no .feant ex 

However, when there had 
pectancy effects were obtained (p < .Uj./- a 

TABLE 12-7 


Expectancy Effects as a 
pectancy Disconfirmation 


Function of Amount of Ex- 
(After McFall, 1 965) 


D/sconf/rmof/on 

Less 

More 

Mean 


expectancy 


+5 

-5 

+.51 

-.40 

-.06 

+.04 

+.22 

-.18 


Difference 

t 

P< 

+ .91 

1.86 

.05 

-.10 

- 

“ 

+.40 

1.04 

.15 


of these effects. McFall and^^ '“"S" 

penmenters expecting a shorter reac of reaction tunes 

reaction time. When the experimenters p .„tancy effects emerged 

rather than magnitude of ratings, hardly any exp z 

(p < .30). , in this chapter it seems that 

From the experimental results pr experiment may be 

Ebbinghaus was right. The d.ata o ,l,e same experiment, 

significant determinants of the data o ,. be discussed in more 

The methodological implications o ^ question of whether it 

detail i" f^or now it is enough i * ^ 


- r- '‘-"^°'''’r,rr;:se the “ 

Ictail in Part III. For now it is as to how the data arc 

night not be useful to tr)' to remain u 
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free to vary at least a little in the ratings they produced If, on the other 
hand, the expectancy factor were operating, the data produced by the 
accomplices would serve to modify the onginal expectancy— by a good 
deal when early returns were disconhrming, and by just a little when early 
returns were confirming (The fact that the correlations were larger 
when the early returns were more similar to the initial expectancies seems 
best understood as an instance of “assimilation effects” as described by 
Helson [1964] and Shenf and Hovland [1961] In psychophysics and 
attitude change alike, small deviations are often more accommodated to 
than large changes ) 

If the personality factor were operative, one would expect expenment- 
ers to have a relatively constant effect on the responses obtained from 
accomplices and from real subjects regardless of order Therefore, the 
correlation between responses obtained from accomplices and those 
obtained from subjects contacted later should be no higher than the corre- 
lation between responses obtained from real subjects contacted early 
and real subjects contacted later The correlation between responses given 
to experimenters by accomplices and those given by real subjects subsequent 
to the first two was -f- 85 (p = 005, one-tail, df = 6) The correlation 
between responses given by the first two real subjects and those given 
by subsequently contacted real subjects was only -j- 16, a correlation not 
significantly greater than zero but appreciably lower than -1-85 (p = 06, 
two-tail) These findings seem inconsistent with the hypothesis of experi- 
menter personaUty effect but consistent with the hypothesis of expenmenter 
expectancy The earliest collected data, if they are not too inconsistent with 
the initial expectancy, may serve to modify or to specify more precisely the 
experimenter’s expectancy 


Delayed action effect. In the earher expenment on the effect of 
early data returns there was a “delayed action effect,” with accomplices’ 
a a a ecting later-contacted real subjects more than earlier-contacted real 
su jects In the second study no such effect was found There was, however, 
a tendency for experimenters’ initial expectancies to become more effective 
lor later than for earlier contacted subjects Initial expectancies (+5 vs 
A ^ ^ obtained from the first two real subjects 

mong su sequently contacted real subjects, however, those contacted by 
expecting +5 ratings gave higher ratings (- 35) 
ratin ’n ^ 1 nr ^ subjects contacted by expenmenters expecting —5 
ratings (t = 1 73, p = 09, two tad, df = 83) 


AN INCREASE IN GENERALITY 

reported by Ebbinghaus and those reported in this chapter 
not the only evidence relevant to the hypothesis of early returns as 
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Little has been said so far about the effects of the expenmenter s mo- 
tives on the operation of expectancy effects. From studies emp oying anima 
subjects it appeared that the experimenters expectancy nng e a more 
important determinant of the results of the 

menter’s motives. In these studies experimenters were mo iva e ... 
their animal subjects learn rapidly; yet the animals learning was impaired 
when the experimenter expected poor performance. 

In some of the earlier studies employing /“SenTwhh 

menters were offered a special incentive to obtain j-ii-fs instead 
their expectancy. In a few studies they were promise ^ 
of the standard one dollar for their participation if “ 

expected.” In these studies there were no control 

these incentives increased the effects of the “P™ . n^ces- 

although it is known from other 51“*“ * ®^^s,,ortly, more formal evi- 
sary for the demonstration of expectancy c • / _ . varyinc 

deuce will be presented which shows *'’e/°nipl.cat ng cffecJs^of^ varying 

types and sizes of incentives on be motivated to do 

so, and probably more to conduct research is 

plan and conduct an expenment. Th ‘ ,„u„s of the 

usually related to certain motivalio posted in the results he 

research. Rarely is the investigator t y . more disinlcr- 

obtains from his research, but very like y disinterested in 

ested than others. The same scientist may b<= f ”, , 

the results of his research on implication for science of the 

A number of workers have ‘’.■“““f of his research. In his 

motivation of the experimenter vis-a ^ ,.5 of the personal 

preface to Mannheim’s Ideology ana he spoke more directly 

investment of the scientist in his research. Tliougliti P 
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turning out until the expenment is completed That would mean that the 
experimenter collecting the data would have to be kept uninformed about 
what data are “good ’ and what data are “bad ” But even if the data col- 
lector were uninformed of this at the beginning, there would be the diffi- 
culty of keeping him uninformed If the expenmenter reported the early 
returns to the principal investigator, there would probably be more or less 
subtle reactions to this report, reactions that might cue the expenmenter 
as to whether data were falling well or poorly If the data seemed to be 
coming well, judging from the principal investigator’s reaction, the data 
collector might make a point of not modifying his behavior toward his 
subjects The data might, therefore, continue to come in as before If the 
data seemed to be coming poorly, judging from the principal investigator’s 
reaction, the data collector might make a point, even if not consciously, of 
modifying his behavior toward his subsequently contacted subjects Such a 
change in behavior, midway through an experiment, might lead to trouble- 
some interactions of experimental treatment conditions with the number 
of subjects contacted Later-collected data might turn out to support the 
experimental hypothesis because of the unintended change in the ex- 
penmenter’s behavior 
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told that the rate of pay would be two dollars per hour for a “good job,” 
exactly as in some of the earlier described studies. The more lu'ghly mo- 
tivated group of six experimenters, however, was told that the rate of pay 
would be five dollars for a good job. 

In addition to the feeling that more highly motivated experimenters 
would show more biasing effects, it was also felt that subjects’ motivation 
level might be an important variable affecting experimenter expectancy 
bias. Accordingly, all subjects were randomly assigned to a paid or an un- 
paid group. All experimenters contacted paid and unpaid subjects alter- 
nately. Paid subjects were told that they would receive fifty cents for their 
five minutes of participation. 

In connection with another study, each subject and each experimenter 
was asked to fill in a lengthy questionnaire concerning their reaction to the 
experiment after their part in it was finished. In addition, before each ex- 
perimenter contacted any subjects he was asked to predict as accurately as 
possible the average rating he would actually obtain from his subjects. 

All experimenters were told to leave the doors to their research rooms 
open, as one of the research supervisors might drop in at any time. It was 
hoped that this might minimize the possibility of actual cheating by the 
more motivated experimenters. 

In this study, magnitude of expectancy effect was defined in two ways. 
Higher mean obtained ratings — i.e., those closer to +7 — were regarded 
as more biased. In addition, a higher positive correlation between the data 
specifically predicted by experimenters and the data subsequently obtained 
by them was regarded as an index of greater expectancy effect. Since ex- 
penjventers had been ied Jo expect a mean rating of their specific 
predictions tended to cluster around that value. Consequently, correlations 
should underestimate the “true” correlations between predicted and ob- 
tained data because of the restriction of range of the experimenters pre- 
dictions. 

Table 13-1 shows the mean ratings obtained by the more and less 
rewarded experimenters, each contacting p^id and unpaid subjects. The 

TABLE 13-1 


Mean Photo Ratings 


BXPERIt^BNTER'S mTIVATION 


h\oderatc ($2) 


.99 

2.28 


SUBJECT’S Higb(paid) 

motivation Moderate (unpaid) 


High (S5) 

.96 

1.24 
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to the problem of interpreter effects than to the problem of expectancy 
effects, his remarks bear repeating “The fact that in the realm of the soci^ 
the observer is part of the observed and hence has a personal stake in the 
subject of observation is one of the chief factors in the acuteness of the 
problem of objectivity in the social sciences" (1936, p xxiv) Similarly, 
Beck (1957, p 201) has stated “Each successive step in the method of 
science calls forth a greater emotional investment and adds to the diffi- 
culties of remaining objective When the ego is involved, self cnticism may 
come hard (Who ever heard of two scientists battling to prove the other 
nght*?)" 

More recently Ann Roe (1959, 1961) discussed the scientists com- 
mitment to his hypothesis and suggested that creative advance may depend 
on It She went on to caution us, however, to be aware of the intense bias 
that accompanies our involvement (In an effort to implement this caution 
against bias, Roe devised the “Dyad Refresher Plan” for checking biases 
in clinical work Lamentably this plan, which suggests penodic recalibra- 
tion of the chmcian, has not been well accepted ) 

Motivational factors in the scientist affecting the work he does have 
been discussed by others as well (Barzun & Graff, 1957, Bingham & Moore, 
1941, Griffith, 1961, Reif, 1961) But perhaps the most eloquent and 
most balanced brief statement on this topic was that by William James 
“ science would be far less advanced than she is if the passionate 
desires of individuals to get their own faiths confirmed had been kept out of 
the game If you want an absolute duffer in an investigation, you 
must, after all, take the man who has no interest whatever in its results he 
IS the warranted incapable, the positive fool The most useful investigator, 
because the most sensitive observer, is always he whose eager interest in 
one side of the question is balanced by an equally keen nervousness lest 
he become deceived’ (1948, p 102) 


THE FmST EXPERIMENT: INDIVIDUAL SUBJECTS 

In the first experiment to investigate the effects of varying incentives 
on experimenter expectancy effects, 12 graduate students in education 
screed as the experimenters (Rosenthal, Fode, & Vikan-Kline, 1960) 
They administered the standard photo-rating task to a total ol 58 under- 
graduate students, of whom 30 were males and 28 females Instructions 
read to subjects were those described m the preceding chapters All cx- 
nxpect mean ratings of about +1 from all their 

The motivation level of the experimenters was defined by the incentive 
° ^ ® » obtaimng high ratings of photos from their 

su jects The more moderately motivated group of six experimenters was 



215 


Excessive Rewards 

stnictions to obtain expectancy biased data. Heretofore these had all been 
relatively implicit. The other variable of interest was whether expectancy 
effects could occur in the situation wherein an experimenter contacts a 
number of subjects simultaneously (Rosenthal, Friedman, Johnson, Fode, 
Schill, White, & Vikan-Kline, 1964). 


THE SECOND EXPERIMENT: SUBJECTS IN GROUPS 

In this second experiment 30 advanced male undergraduates, primarily 
from the College of Engineering, served as experimenters. With the modifi- 
cations to be noted, they administered the photo-rating task to a total o 
150 subjects, 90 males and 60 females, all of whom were students of in- 

™ « in. l-F « -P',-- 

menters each. Four of the treatment groups were led to expect h'gh posihve 
ratings (4-5) of the photos from their subjects, and the remaining gr p 
was fed\T expect high negative ratings (-5) from -bjects^In order o 
test the effect of reward or motivation, half of the 

high positive ratings from their subjects were given a doUar biU and told 
lUSirthey did a “better” job-l.e., obtained 

the effect of the explicitness of instrucUons to bjas 

half the experimenters ^ expected'^Jatn, but without deviat- 

menters expecting high liss wplidUy biased. The six ex- 
ratings, and were thus considered explicit 

perimenters expecting .'’‘S’’ | | ^ two-person sum- 

instructions to bias their subject and were also given t- 

zero game condition of motivation. , - cinnle evening. The locale 

across from them. Each photo was presen 

turn. Subjects recorded VeZ ^:e ’them. The p'^irpose of 

shown to the experimenter so 'ha' J „ <.,,eck on any re- 

having this double recording of rating F 

cording errors a='P=d'n'=n'prs ■nig t ma . differential wording 

The treatment conditions were actu y y 
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analysis of variance revealed no differences in data obtained as a funcbon 
of either of the treatments operating alone The mean rating obtained by 
the more moderately mobvated expenmenters, when contacting nnpaid 
snbjects, did seem to be more biased than did the other three means of 
Table 13-1 (p = 03, two-tail, r = 6 94, rf/ = 2). This was surprising, since 
It had been thought that the more highly motivated expenmenters, espe- 
cially when contacting paid subjects, would show the greatest expectancy 
effects This first hint that an increase in motivation level (especially of 
expenmenters, but of subjects as well) might decrease the effects of the 
expenmenter’s expectancy was further checked 


TABLE 13—2 


Correlations Between Experimenters' Predicted and 
Obtained Ratings 


SUBJECT'S 

MOTIVATION 


High (paid) 
Moderate (unpaid) 
All soh/ecfs 


EXPERIMENTER'S MOTIVATION 
High (S5) Moderate ($2) 

-.60 +.24 

-.31 +.84* 

-.31 +.99** 


• * p _ (Iwo-tail) 


Table 13-2 shows the correlations (rhos) between the data experi- 
menters had specifically predicted they would obtain and the data they 
subsequently did obtain This cntenon (or definition) of expenmenter 
expectancy effect correlated 80 with the definition of expectancy effect 
based on photo ratings obtained (Table 13-1) Only among moderately 
motivated expenmenters contacting moderately motivated subjects was the 
magmtude of expectancy effect significantly greater than zero Disregarding 
motivation of subjects, it was found that the more moderately motivated 
exjKnmenters biased their subjects’ responses more than did the more 
highly mohvated expenmenters The latter group, in fact, tended to show a 
si^tfcLr ” “P^htancy effect, though this was not statistically 

The results just described led to a further investigation of the effect of 
the expenmenter’s motivation level There was curiosity at this point, too, 
a out two other variables One was the degree of explicitness of the m- 
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TABLE 13-4 


Correlations Between Experimenters' Predicted and 
Obtained Ratings 


INSTRUCTIONS 


EXPERIMENTER'S MOTIVATION 
High Moderate 

Explicit .00* —.10 

Implicit -.21 +-59 


♦ ^^21 was the comparable correlation among experimenters expecting 
**— 5" rotings. 


conditions ot the two studies. Considered together, these studies suggest 
that "excessive” rewards for expectancy effects actually led to decreased 
expectancy effects under the particular conditions of the ^ 

described. The more explicitly instructed-to-bias and j 

experimenters expecting “-5” ratings obtained raungs higher 
anVtreatment condition imposed on expenmenters expecung +5 mean 
miss This finding (two-tail, p = .13), together with the negauve cor- 
relatfons represenUng magnitude of expectancy ^ 

motivated treatment conditions, suggest the possibility that these expen 
menters were actively biased into a reversed direcuon. 

In an earlier chapter, the finding that expenmenters com^tationa 
errors in data processing were not randomly distnbuted was reported. It 


TABLE 13-5 


Correlations Between Experimenters' Predicted and 
Obtained Rotings for Analogous Treotment Condi- 
tions of Two Studies 


Study 1 
Study II 

A*ecns 


EXPERIM£NTER'S motivation 


High 


-.31 

-.21 


Moderate 

t.B4 

..59 


-.26 


..74 


p Difference 
(Two-Tail) 

.06 

.27 

.05 
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of “last imnute instructions ” which expenmenters found at their tables the 
night of the experiment Each of the treatments was represented equally 
often m the different parts of the armory Order of arrival then determined 
assignment of expenmenters to tables, with earlier and later amvers repre- 
sented equally often among treatments 

Subjects were similarly assigned to expenmenters, except that each 
table had three male and two female subjects Positions of males and fe- 
males VIS a VIS the expenmenter were systematically vaned within treatments 
Each expenmenter was asked to predict the specific mean photo ratmg 
he would obtain After the photos had been rated, each subject filled out a 
senes of 20 point rating scales descnbing his experimenter’s behavior dunng 
the course of the expenment Each scale ran from —10 (e g , extremely 
unfriendly) to -flO (eg, extremely fnendly) Experimenters also rated 
their own behavior on the same set of rating scales 

Table 13-3 shows the mean ratings obtained by the more and less 
motivated experimenters under more and less exphcit instructions to obtain 


TABLE 13-3 


Mean Photo Ratings 


INSTRUCTIONS 


EXPERIMENTER’S MOTIVATION 



High 

Moc/erafe 

Exphcit 

- 23* 

- 02 

Implicit 

- 35 

- 17 


+ 14 was the comparable mean obtained by experimenters expecting 
-5 ratings 


expectancy biased data More motivated experimenters tended to show less 
expectancy effect than did less motivated expenmenters (p = 05) Ex- 
pucitaess of instructions to obtain biased data had at best only an equivocal 
^ n ® 13 4 shows the correlations between data experimenters had 
speci ca y predicted they would obtain and the data they subsequently did 
^Tii correlations was significantly different from zero 

e analogous treatment conditions from the two expenments de- 
scnDed here were those in which more and less motivated experimenters 
were imp citly set to bias the responses of unpaid subjects Table 13 5 
shows that rather similar correlations were obtained under the analogous 
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C. Norris (in a personal communication) has related an anecdote that 
seems to illustrate nicely this bending over baekward to insure freedom 
from bias: 

Briefly, the situation involved an experiment in which the faculty member 
took a rather firm position consistent with Hullian theory and fte student, being 
unschooled in Hullian theory, took a directly contradictory point of view based 
on some personal experience he had had in a similar situation They diseased 
the expectations at some length and each experimenter was famdiar ‘he 
point of view that the other was advancing. However, each felt some very de p 
Lmmitment to his own expectations. When the results o 

analyzed it was found that there was a significant treatment-by-expenrnentCT 
interaction Further analysis demonstrated that this interaction consisted of each 
experTmen^ *c results that the other expected. Through some deep 
soul searching and interrogation both the experimenters h“™o oonvmccd ‘hat 
they had hent over backwards to avoid biasing the 

theh prediction and consequently produced results antagomstic to their predic 
tions. 

MUls (1958) found that honest sixth graders became 
cheating under conditions of high motivation to cheat In "n he 
found that under conditions of high restraint against cheating, subjec s M 
ca^e morl anti-cheating than did similarly highly on 

conditions of low restraint against cheating. i , ^ susoected and 

therefore denouncing cheating more veheme f & 

both experiments reported in this chapter 

„ 1. .b. “ 

check !i°p on'theTin the second .^^^XtitranT^my 

constant circulation about ™ o,ivo,ed experimenters may have 

procedural deviations. The more g J evaluated because of their 

felt that their behavior m particul g backward to 

higher stakes. This may have led "'J^^^'^ubiccts. 
avoid appearing in “y ^und thaf subjects under conditions 

Festmger and Carlsmith O’ ^ ^ „e„„er dissonant from 

of lower reward, when forced to beh h-liefs toward their publicly 

their private belief. ‘hc'r pnv This 

stated ones more than did (jpjg) have been in- 
finding and those of Kelman (19 > ,heory (1957) of cognitive 

terpreted within the framework motivated 

dissonance. The finding from t p consistent with the 

experimenters tend to ®h°w “ ^ svithin the framework of dis- 

studies reviewed and may also b rp Schill, NVhitc, & 

sonance theory (Rosenthal, Fnedman. Johnson. 

Vikan-Kline, 1964). 
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can be reasoned that those more motivated expenmenters whose computa- 
tional errors favored the induced expectancy might also have biased their 
subjects’ responses into the direction of the induced expectancy By similar 
reasoning, those more motivated expenmenters whose computational errors 
did not favor the induced hypothesis should not have biased their subjects 
responses into the direction of their expectancy This latter group of expen- 
menters might be the one most likely to show a “reverse bias” effect Among 
the less motivated experimenters there was no difference m data obtained 
by expenmenters erring computationally in the direction of the hypothesis 
(-j-5) and those ernng in the opposite direction Among the more moti- 
vated expenmenters, however, this difference was significant at the 10 level 
(two tail) The mean photo rating obtained by more motivated expen- 
menters subsequently erring computationally m the direction of their 
hypothesis (-1-5) was -j- 23, whereas the mean obtained by those not 
erring in this direction computationally was — 55 (These means, of course, 
were corrected for the effect of the errors themselves ) The effect of exces- 
sive reward seems to be to increase the vanabihty of data obtained (p < 
05) Some expenmenters appear to be sigmficantly more biased by exces- 
sive reward, whereas some expenmenters appear to be significantly less, or 
even negatively, biased 


SOME DISCUSSION 

Why might one effect of excessive incentive to bias subjects’ data be 
to reduce or even to reverse the expectancy effect of the expenmenters'^ 
In a postexpenmental group discussion with the experimenters of the sec- 
ond study, many of them seemed somewhat upset by the experimental 
gomgs-on Several of them used the term “payola,” suggesting that they 
felt that the investigators were bnbing them to get “good” data, which was, 
in a sense, true Since money had been mentioned and dispensed to only the 
more motivated expenmenters of this study, it seems likely that they were 
the ones perceiving the situation in this way Kelman (1953) found that 
subjects under higher motivation to conform to an experimenter showed 
ess conformity than did subjects under lower conditions of motiva- 
ion One of several of Kelman’s interpretations was that the subjects who 
were rewarded more may have felt more as though they were being bnbed 
to contorm for the experimenter’s own benefit, thus making subjects suspi 
aous an resentful, and therefore less suscephble to experimenter influence 
This mte^retation fits the present situahon quite well 

Ferber and Wales (1952) concluded from their data that in the inter- 
viewing situation if the interviewer is biased and knows it, he may show a 
negative bias as part of an overreactive attempt to overcome his known 
bias Although this was not found consistently in their study, it seems to 
help in the interpretation of the “reverse ’bias phenomenon Dr Raymond 
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pleted the same forms describing their own behavior during the experiment. 
Neither experimenters nor subjects knew beforehand that they would be 
asked to complete these questionnaires, and no one save the investigators 
saw the completed forms (Rosenthal, Fode, Friedman, & Vikan-Kline, 
1960). These forms consisted of 27 twenty-point rating scales ranging 
from — 10 (e.g., extremely discourteous) to -)-10 (e.g., extremely courte- 
ous). The more desirable-sounding poles of the scales appeared about 
equally often on the right and left of the page. AH scales were completed 
by all 12 experimenters and by 56 of the 58 subjects. 

Table 13-6 shows the mean ratings of the experimenters by their sub- 

TABLE 13-6 


Mean Ratings of Experimenters' Behavior 


Rating Scale 

Satisfied with experiment 

Liking 

Honest 

Friendly 

Personal 

Quiet (nontalkative) 

Relaxed 

Quiet (nonfoucf) 

Casual 

Enthusiastic 

Interested 

Courteous 

Businesslike 

Professional 

Pleosont-voiced 

SloW'Speaking 

Expressive-voiced 

Encouraging 
Behaved consistently 
Pleasont 

Use of hond gestures 
Use of head gestures 
Use of arm gestures 
Use of trunk 
Use of legs 
Use of body 
Expressive foce 


By Subjects 

By Experimenters 

1.44 

5.09 

5.16 (of £) 

5.00 (of S) 

7.56 

8.55 

5.50 

4.82 

-0.36 

1.45 

1.89 

4.73 

5.82 

4.73 

2.79 

2.S5 

5.80 

5.36 

2.49 

3.45 

4.12 

5.09 

6.89 

7.09 

5.45 

6.36 

4.66 

5.45 

7.39 

6.27 

1.55 

2.45 

3.16 

2.18 

3.53 

4.27 

6.31 

6.82 

6.40 

5.82 

-2.02 

2.18 

-0.72 

-0.36 

-2.18 

-2.27 

-2.75 

-2.27 

-2.86 

-2.55 

-1.27 

-0.09 

2.57 

0.73 
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Perhaps the most parsimonious interpretation of the reversal of ex- 
pectancy effects IS in terms of Rosenberg’s concept of evaluation apprehen- 
sion (1965 and in personal communication) The experimenters of the 
studies descnbed were, of course, a special kind of subject who may well 
have experienced some apprehension about what the principal investigators 
might think of them Both the autonomy and honesty of the expenmenters 
may have been challenged by offenng large incentives for affecting the re- 
sults of their research By bending over backward, the expenmenters could 
establish that they would not be either browbeaten or bribed to affect their 
subjects’ responses as their pnncipal investigators had “demanded ’’ Such 


an interpretation speaks well of the mtegnty of the expenmenters, but it 
must be noted that the results of the research were still affected, though in 
this case m the direction opposite to that expected 

No single interpretation of the results of these studies is entirely satis- 
factory That IS because the locus of the reversal of expectancy effects can- 
not be determined from the data available The interpretations offered so 
far have assumed the locus to fall within the experimenter In view of the 
experimenters’ very obvious concern with the question of bribery, the as- 
sumption seems reasonable It is also possible, however, that the locus of 
the reversal of expectancy effects falls within the subject That is what we 
would expect if the more motivated experimenter tried too hard to influence 
s subjects The subjects feeling pushed by an experimenter who “comes on 
00 strong may resist his efforts at influencing their responses This self- 
assertion through noncompliance may operate in the service of evaluation 
apprehension if the subject feels that the experimenter would think the less 
of him if he complied 

cpcf Schultz (1963), and Silverman (1965) have all sug- 

frt ^ 1 ^ influence attempts become more obvious, subjects be- 

This may be a trend o£ the future as much or more 
nf^rtrr, ^ ^ moFc Dod moie subjects of psychological ex- 

Lnfnm! acquainted with the results of the classic research in 

to ^ there may be more and more determination 

those mmHi “P“™cutcr that the subject is not to be regarded as “one of 
courses are iT *>>ich instructors of elementary psychology 

m this chanter ‘‘i ^ '*’c studies descnbed 

both in the ero ^ of expectancy effects is to be found 

“subjects ” (''>'0 were subjects) and in the subjects of these 


SUBJECTS PERCEPTION OF THEIR EXPERIMENTER 

each wibJeet 'o' of the first experiment described m this chapter, 

each subject was asked to fill out a questionnaire descnbing the behavior of 
his experimenter dunng the course of the expenment Expenmenters com- 
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Table 13-7 also shows the subjects’ mean rating of their experi- 
menters for each of the four clusters. The mean rating on the “Casual- 
Pleasant” cluster was significantly higher (p = .002) 4an the mean 
rating on the “Expressive-Friendly” and the “Enthusiastic-Profession 
clustL, which were not significantly different ™“e 

rating on these latter two clusters, in turn, was significantly higher than the 

mean rating on the “Kinesic Cluster (p = .002). . . 

The 12 experimenters rated for their dyadic behavior had Mt um- 
formly influenced the responses they obtained from 

now to the question of whether those experimenters who showed greater 
Ztive Sie^tancy effects were perceived by their subjects as in any way 
SentTn their e^erimental interaction from those experimenters who 
showed less or even a reversal of expectancy effects. t, j orv 

In orLr to answer this question, all experimenters were ranked ac- 

data an experimenter specifically predicte neater the ex- 

he actuaUy did obtain. The smaffer this 

only those correlations reaching a p • ’ interested, 

positive expectancy effects were vie y 

likable, and personal; as slower spea relation- 

hand, head, and leg gestures and number of correlations 

ships may have occurred by of the relationship between 

computed, we may obtain a more P magnitude of his ex- 

?ir; 

variables in Clusters I and IV w a p = -SO- 7^*’® "tedian cor- 

significantly greater than a corre a on variables in Clustere II 

relations with magnitude of expec y median correlations 

and III were .47 and .43, «*P'<=‘'''''y-®°*be often expected by chance 
were significantly greater than a con .j. ^ expectancy biased 

(ps were .04 and .01, "'P'^T/Jbrtoher loadings on the “Expres- 
experimenters, then, were _ These findings suggested that 

sive-Friendly” and the “Kinesic c aspects of the 


sive-Friendly” and the “Kinesic voice) aspects of the 

kinesic and possibly parahn^is ‘h” to communicate the M- 

experimenter’s interaction with is ] p evidence bearing on this 

peLenter’s expectancy to chapters, 

formulation will be presented m the follomng 
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jects and by themselves Both sets of ratings reflected very favorably on the 
expenmenters The profile of the experimenters as they were viewed by 
subjects showed remarkable similanty to the profile of the expenmenters 
as viewed by themselves The rank correlation between profiles was 89, 
p < 0005 (It has been shown elsewhere that such correlations are in- 
creased by the commonly shared stereotype of the psychological expen- 
menter [Rosenthal & Persinger, 1962] ) To summanze and facilitate 
interpretation of the obtained ratings, all variables were mtercorrelated and 
cluster-analyzed Table 13-7 defines the four clusters that emerged The 
associated B-coefficients are all considerably larger than generally deemed 
necessary to establish the significance of a cluster (Fruchter, 1954) For 
mnemonic purposes we may label Cluster I as “Casual-Pleasant,” Cluster 
II as “Expressive-Fnendly,” Cluster III as “Kinesic” or “Gestural Activity,” 
and Cluster IV as “Enthusiastic-Professional ” The only scale not ac- 
commodated within any cluster was “quiet (nonloud) ” 


TABLE 13-7 


Cluster Analysis of Subjects' Perceptions of Experi- 
menters' Behavior 


Cluster I 6 a 6 48 

Honest 

Casual 

Relaxed 

Pleosont 

Courteous 

Businesslike 

Slow-speaking 

Pleasant-voiced 

Behaved consistently 

Mean rating =5 9] 

Cluster III 6-9 70 

Use of head gestures 
Use of arm gestures 
Use of trunk 
Use of body 
Use of legs 

Wean rating *= —7.96 


Cluster II B a 3.97 

Liking 

Friendly 

Personal 

Interested 

Encouraging 

Expressive face 

Expressive-voiced 

Use of hand gestures 

Satisfied with experiment 

Weon roting = 2 57 

Cluster IV B = 3 55 
Enthusiastic 
Professional 
Quiet (nontalkat ive) 


Aleon roting = 3 07 
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described, the subjects were also asked to make ratings of their experi- 
menter’s behavior during the conduct of the experiment. Eleven of the 
experimenters in that study made computational errors in their data process- 
ing in the direction of their hypothesis. These experimenters were rated an 
average of -f-6.8 on the scale of “honesty” by their 55 subjects. The 65 
subjects of the remaining 13 experimenters rated them as 4-8.5, on the 
average, on the same scale. The ^fference between these mean ratings was 
significant at the .02 level (two-tml, t = 2.67, df = 22). Thus, whereas all 
experimenters were rated as quite honest (whatever that word might have 
meant to the subjects), those experimenters who later made computational 
errors in their hypothesis’ favor wer& seen as somewhat less honest. Just 
how subjects were able to predict their experimenters* computational errors 
from their judgments of experimenters’ behavior during the experiment is a 
fascinating question for wWch we presently have no answer. Clearly, how- 
ever, subjects learn a good deal about their experimenter in the brief inter- 
action of the person-perception experiment conducted. When a subject 
rates the behavior of an experimenter, we may do well to take his rating 
seriously. 



224 


Studies of Experimenter Expectancy Effects 


TABLE 13-8 


Perceptions of Experimenters' Behavior and Magni- 
tude of Expectancy Effects 


Variables 


Correlation 


Satisfied with experiment 

Liking 

Honest 

Friendly 

Personal 

Quiet (nontalkative) 

Relaxed 

Quiet (nonloud) 

Casual 

Enthusiastic 

Interested 

Courteous 

Businesslike 

Professional 

Pleasont-voiced 

Slow-s pecking 

Expressive-voiced 

Encouraging 

Behaved consistently 

Pleasant 

Use of hand gestures 
Use of arm gestures 
Use of head gestures 
Use of trunk 
Use of legs 
Use of body 
Expressive face 


.17 

.56* 

.06 

.15 

.53* 

-.09 

.31 

-.41 

.35 

.39 

71*** 

-.04 

26 

.21 

43 

64** 

47 

12 

23 

24 

61** 

34 

52* 

34 

55* 

43 

39 


* P < 10 

**p < 05 (two.toil) 

***p < 01 


predicting computational errors 

ticiDated under discussion were those who par- 

ticipated in the first study descnbed in this chapter In the second study 
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structural Variables 

The additional purpose of the experiments to be reported, then, to 
learn whether the effects of experimenter expectancy might be generahzed 
to include the two data collection situations described. Accordingly, in the 
first experiment, experimenters collected data from subjects under one con- 
dition of expectancy; then, some time later, these same expenmenters col- 
lected data from a fresh sample of subjeets under an ^ ^'^7“ ° 

expectancy. In the second experiment, experimenters 7. 

da?a on a single occasion but with opposite expectancies of the responses 
to be obtained from subjects randomly distributed through the enes. If 
experimenter expectancy effects could occur Xante 

would lend further support to the suggestion made “ f^t c ^ i 
that experimenters- hypotheses about <=“bjects respo^s imgh^^^^^^^^^ 
the midst of an experiment, and still serve as self-fulfilling prophecies. 

The First Experiment 

ance served as expenmenters. The su J S females. 

enroUed in various elementary courses 23 J^XX^idually the stand- 

“i' sK..?.!.. 

‘“^"Each experimenter was randomly -^/X'rs^wem mfd\tV°e™S 

In the first ^m' thSects^rwould be contacting suggested that 

test data available from the subje remaining two ex- 

they would give mean photo expect opposite results, 

perimenters (one male, one fern ) ^ „ collected data from 

mean ratings of -5. At ‘7 ‘‘7,1" eacrexperimenter contacted about 
about five subjects. Several weeks , j earlier been led 

to expect mean ratings of +0 were „ncctinc —5 ratings were 

pectancies of those experimenters ini ^ ^c simply that this 

Lilarly reversed. Explanations irracteristics.'^ 

second set of subjects had °PP°7of experimenter expectancy effect upon 
For each subject, magnitude of expenmen p 

that subject was defined as the di subjects contacted under the 

photo rating and the mean of the ra.mgs |^sub,«^^ 
opposite condition of expectancy. P . . rating was higher it the 
difference was the predicted j- if the experimenter expected 

experimenter expected him „ „f ihe cflects of experimenter 

him to rate —5. The analysis o ' j subject sex yielded only a 

expectancy as a function of expenmenter 1 
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Are there some experimenters who, more than others, unintentionally 
affect the results of their research‘d Are there some subjects who, more than 
others, are susceptible to the unintentional influence of their experimenter’s 
expectancy'd The present chapter is addressed to these questions The an- 
swers to these questions should increase our general understanding of the 
effects of the expenmenter’s expectancy and perhaps provide us with some 
clues to the effective control of these effects In addition, the answers to 
these questions may suggest to us whether the unintentional influence 
processes under study are facilitated by factors similar to those that facili- 
tate the more usually investigated processes of social influence 


experimenter and subject sex 

mpnt^ of studies have been conducted to learn the role of experi- 

In operation of experimenter expectancy effects 

tn hp experiments to be described first there was an additional purpose 
Mo« Persinger, Mulry, Vikan-Kline, & Grothe, 1964 a) 

nnnrpn,. described up to now had suffered from a certain 

all thiir design The experimenters employed had expected 

choIooiMi^ ^ specific type of response In “actual” psy- 

ent kinds experimenters normally expect two or more differ- 

conditinn their subjects, depending upon the experimental 

exDeriTnpnt° subject has been assigned In some psychological 

mental mnd ®^P®"™^”ters first collect data from subjects in one experi- 
other exnpr,* subjects m the other condition(s) In 

lected subjects representing all conditions are col- 

different rn Occasion, with the order of appearance of subjects from 

different conditions either systematically or randomly varied 
226 
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The analysis of variance yielded significant main effects of experi- 
menter and subject sex. Male experimenters obtained more biased responses 
than did female experimenters (F = 4.20, p = .05). Female subjects were 
more susceptible to experimenter expectancy effects than were male sub- 
jects (F = 7.67, p = .01). The interaction was, however, somewhat too 
large to ignore entirely (F = 1.79, p = .20). 


TABLE 14-2 


Expectancy Effects as a Function of Sex of Expert 
menter and Subject: Second Experiment 


E Sex 

S Sex 

Mean 

t 

Male 

Male 

Female 

+.72 

+1.54 

.94 

2.17 

Female 

Male 

Female 

-1.37 

+.99 

3.70 

3.41 


df 

P 

p (Both Experiments } 

5 

.40 

.01 

10 

.06 

.01 

6 

.01 

.03 

10 

.01 

.001 


Table 14-2 shows the mean expectancy bias 

ment combinations. In this f Xain response opposite 

male experimenters contacting male subjects to ob am espon PP 

to those%ected was found ^8=-*" “."‘'7°7„”',lt1i«rsal was .03 (c = 
both experiments together the com me F predicted effects’ oc- 

1.93). In this second study the go 2 = 3.06); for 

currence among the other threejoncht ons was < .UU2 

both experiments p < .0001 (z — • , .oaether it appears that 

Considering the results of both 

male experimenters may uninten lo ^ o„ the other hand, the 

male and female subjects. For fern P female subjects to give pre- 
situation is more complex. Influen 8 ^ results from their male sub- 

dicted responses, they seem to o ai PP , the subtle inlluencc 

jeets. It appears horn ®'8"' expectancy effects is perceived ac- 
process that mediates experim otherwise we would have expected 

curately enough by the male ™ ’,,jj(.t 5 _ however, may feel somehow 

no expectancy effects at all. M J influence them in this way. In 
they ought not to let female expen experimenters data 

response, they may then ten 8 demonstration of their masculine 
opposite to that subtly requested as a 

independence. ^rimf^nts also extend the generality o 

The results of these experimenter expectancies on the 

earlier findings bearing on the 
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TABLE 14-1 


Expectancy Effects as a Function of Sex of Experi- 
menter and Subject 


E Sex 

S Sex 

Mean 

f 

df 

p (Mean = 0) 

Male 

Male 

+1 33 

3 01 

16 

01 

Female 

+ 78 

1 54 

14 

16 

Female 

Male 

Female 

-25 
+1 22 

47 
2 11 

5 

13 

66 

06 

sigmficant interaction (F = 

3 05, p 

= 10) 

Table 

14-1 shows the mean 


expectancy bias score for each sex of experimenter by each sex of subject 
For each of the four conditions the tabulated ps represent the likelihood 
that for the particular combination of expenmenter and subject sex the 
magnitude of expectancy effect could have occurred by chance Among the 
female experimenters contacting male subjects there was a nonsignificant 
trend for the data obtained to be opposite to that expected Among the 
three remaining groups the combined p of experimenters’ expectancy af- 
fecting subjects was 0005 (z = 3 39) 


The Second Experiment 


IX advanced undergraduate and beginning graduate students enrolled 
in psyc 0 ogy courses served as experimenters, three were females All had 
serve as experimenters in an earlier experiment and were familiar with the 
j (Persinger, 1962) The subjects were 35 under- 

fn/i ^ enrolled m vanous elementary courses, 22 were females, 

ana 13 wprp TTifiiae ■' ’ 


as in ^ general instructions to expenmenters were 

ranHnmit ^^P^nment Each expenmenter collected data from about six 
mcnten! consecutively in a single session Expen- 

some woiiiH subjects were of two personality types and that 

—5 raimo average -{-5 photo ratings while others would average 

which ortf meeting each subject, the experimenter was told to 

vaned subject belonged Expenmenter expectancies thus were 

order in ^ amounted to a roughly alternating schedule In 

mcntcr^ J f procedural deviations, however, all expen- 

With all subjects About half 
Neither cTn/. permanently recorded on 16 mm sound film 

tntenfinmi^r,"*^^i'**^^ subjects wcrc awarc of this monitonng and no 
intentional procedural deviations were noted 
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the effects of expenmenters’ expectancies on subjects’ latencies in a word 
associauon task The results suggested that male expenmenters umntention- 
ally influenced their female subjects more and that female experiment 
iXenced their male subjects more This interaction may be specifically 
associated with the task employed by Silverman 

The susceptibihty under discussion is to a subtle, umntended form 
social influence*^ We have no empincal basis for assuming that those charac- 
tensucs increasing susceptibdity to expenmenter ^ 

be the same charactenstics found to increase susceptib hty to other, more 
commonly investigated forms of social influence Should this 
the case Lwever, we may entertam the hope of a /P f ‘ 

?hat "’the results may exmnd the generality of the 

area of social influence processes whde at the same ,_veftieat!on 

ceptual mche within that somewhat 

Jthe question of relating subject sex of 

fluence, we find ourselves fortunate '"deed f “ a vane^^“ 
less subtle forms of influence, female su j roffin 1941 Crutch- 

more mfluenceab.e Fuhrer, 

field, 1955, Hovland & Jams, 1959, Jenness, 

1961, Simmons & Christy, 1962) -t response to specific 

TO expect a sex-hnked genetic mspo^^^^^ 

situations by college *ihty to interpersonal influence we 

To the extent that sex predicts susc p ^ j^rve to approve 

may postulate that cultural sanctions ar p ® data tend to 

woL'n’s >nfluenceabdtty more to me^n sJo«^ 

bear this out for the s‘<'‘^“on wh ,„fluLceable, or more success- 

influence (Rosenthal & Fode, 19 ) ^ influencing expen- 

fully biased, female subjects were biased, male subjects 

menters (rho = + 59) More (rho = 

were very significantly less y ,j„gnrers were male, subjects 

- 54) In this experiment, in “ P experimenter felt they fit 

may have been liked to ‘1'® ^^n,e,e.acquiesccnce and male-autonomy 

their culturally prescribed roles subjects from an expcn- 

That females may prove to be m accidentally reported 

menter’s point of view has been in ere . g due to their suspi- 

Foster (iWl) briefly d-cusseton." About 32 

cion that his Asch-type conform y enouch to warrant their being 

percent of his male subjects were susp ^bout 1 3 percent of his female 
dropped from the expenment, w creas fascinating if moot question 

subjects claimed this degree o P ur did they by virtue of 

might be were the girls actual y P ^be greater “decency 

greater degree of -9-“ ^ ,bey believed he might not 

. report to an experimenter sometm g 

* • the uninlcn- 


some 
not to 


wishtohear'^ _ ..onllv less successful in 

If female expenmenters were y 
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responses obtained from their subjects The plausibility of the earher sug- 
gestion that expenmenters may alter their hypotheses in midexpenment 
and then obtain data m accord with the revised expectancy seems somewhat 
increased 


A subsequent study was undertaken to further evaluate the effects of 
subjects’ sex (Rosenthal, Persinger, Mulry, Vikan-Klme, & Grothe, 1964b) 
The procedure m this study was very similar to that of the study just re- 
ported Eight male experimenters conducted the photo rating experiment 
with 32 female subjects Another 5 male expenmenters conducted the same 
expenment with 13 male subjects Each experimenter was led to expect 
about half his subjects to make photo ratings of 4 - 5 , the remaining subjects 
were expected to make ratings of — 5 Only 38 percent of the male subjects 
gave ratings in the expected direction, whereas 69 percent of the female 
subjects gave such biased ratings For this sample of male experimenters, 
then, female subjects were clearly more susceptible to the biasing effects of 
their expenmenters’ hypotheses (p < 05, two tail) 

Data presented by Marcia (1961) were analyzable for differential 
lasing effects of male and female expenmenters Among his female ex- 
penmenters the correlation between the expenmenters’ expectancy and the 
a a su sequently obtained was only ~ 34 Among male experimenters the 
n ogous correlation was 4 - 62 However, because the total number of 
expenmenters was only 13. the difference between these rhos was not very 
significant statistically (p = I 6 , two-tail) 

of (1962) also investigated sex 

effect? subjects as factors m the operation of expectancy 

this ch^^tf■^*F occasion to refer to his study m more detail later in 
menter e k*' simply state that the combination of expen- 

wherem maleic showing the most extreme biasing effects was that 

One (p = 07. two-tail) 

mcnters Th,« ‘h® expectancy e£Eects of their expen- 

Persineer Vikan summarized in an earlier chapter (Rosenthal, 

nowtoeme^ r^'r’ ^ Th= P>cture that seems 

expectancy effects than dofe"”!’ 'how more significant 

stsLt onl ""‘‘■“S' =* 

menters to hnc th<. a ♦ specific inability of female expen- 

for this was advanced 63?]'™ 

were foundTenveL'mfl'fa^r/ conducted in which no differences 

wherein male found, however, a situation 

.ton, .. d^s seem' 

It is the femalp cuK conclude that where a sex difference does occur 
cxceron susceptibility The possible 

exception to this has just been reported by Silverman (1965) He studied 
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ers the correlation could not reach significance The results are at least sug- 
gestive Male principal investigators tend to influence their male research 
assistants to influence their subjects unintentionally to about the same de- 
gree as they themselves influenced their own subjects Female principal 
investigators do not show this tendency In fact, they tend to show a reversal 
of this effect Just as male subjects may resist the unmtenbonal influence 
attempts of their female expenmenters, male research assistants may resist 
the unintentional influence attempts of their female principal investigators 


EXPERIMENTER AND SUBJECT ANXIETY 

An experiment conducted by Fode (1965) was designed specifically 
to show whether experimenters’ or subjects’ anxiety level might be related 
to the occurrence of expectancy effects He employed a total of 16 expen- 
menters each of whom administered the standard photo rating task to an 
average of 10 subjects Some expenmenters were led to expect positive 
ratmgs of the photos and some were led to expect negative ratings Anxiety 
level was defined by scores on the Taylor Manifest Anxiety Scale (MAS) 
Magmtude of expectancy effects was defined by the difference scores be- 
tween ratings obtained under the two conditions of expectancy A plus sign 
preceding this difference score means that higher ratings were obtained by 
expenmenters expecting higher rather than lower ratings Table 14-4 shows 
the results of (he Fode expenment Examination of the marginals shows that 
medium-anxious expenmenters exerted the greatest expectancy effects upon 
their subjects Similarly, more medium-anxious subjects showed the great- 
est susceptibihty to expenmenter expectancy effects 

Six additionaf expenments (94 experimenters, 432 subjects), all em- 

TABLE 14-4 


Expectancy Effects at Three Levels of Experimenter 
and Subject Anxiety (After Fode, 1965) 


EXPERIMENTER'S 

ANXIETY 


SUBJECT'S 

ANXIETY 


High 

Mec/ium 

Low 

Mean 


High 

Medium 

Low 

Mean 

+ 1 17 

+1 23 

+0 04 

+0 82 

+0 72 

+2 13 

+1 85 

+1 57 

+0 23 

+0 08 

-0 18 

+0 04 

+0 71 

+1.15 

+0 57 

+0 81 
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tional influencing of their male subjects, we might also expect that female 
expenmenters would be less successful in influencing their male research 
assistants to obtain the data predicted One expenment, which has been 
cited earlier and will be discussed again later, could be analyzed to help 
answer this question (Rosenthal, Persinger, Vikan-Klme, & Mulry, 1963) 
There were 10 male expenmenters and 3 female expenmenters who were 
given one of two opposite expectancies for responses to the photo-rating 
task Table 14-3 shows the magnitudes of expectancy effects defined as the 

TABLE 14-3 


Expectancy Effects of Experimenters and of Their 
Research Assistants as a Function of Experimenter's 
Sex 


experimenter’s su6/ec/s 
Assistants' subjects 

Difference 
Onc’lail p 


EXPERIMENTER'S 

SEX 


Mate 

Female 

+ 37 

+ 30 

+ 32 

- 07 

+ 05 

+ 37 

NS 

10 


One-tail 

Difference p 

+ 07 NS 

+ 39 07 


nliis «i(Tn ratings obtained under each of the two expectancies A 

The difference was in the direction of the expectancy 

own subiectc’^ ^ ^ shows that female expenmenters affected their 
Each exnpnm/7^*^!^^* almost as much as did the male expenmenters 
research^as<!iQf'i”f^^n pnncipal investigator and trained two 

data the exne " ^ ^’‘penmenters were told not to tell their assistants what 
Table ,4-3 them to obtain The second row of 
expectanev tn th ^ /nale experimenters were able to communicate their 

expenmenters ^ research assistants in some covert manner Female 

male research' ice f significantly less successful at influencing their 
obtain from their^ obtain ,he data they expected the assistants to 

of an cxnenmpnf^ » + 66 (p < 05, two tail) between the magnitude 

tude of his resei effects on his own subjects and the magni- 

.he f:Ltr:r;;nLmr"h: ™ 

(rho = — 1 00 n — T 3 correlation was in the opposite direction 
» P , two-tail), though with so few female expenment- 
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More-anxious subjects have been found more susceptible to mterpersond 
influence in “conditioning” situations by a number 
Winder, 1961, Haner & Whitney, 1960, Sarason, 1958, Taffel 1955) 
although others have not found anxiety to be a relevant vanable m the same 
situation (BUSS & Gerjuoy, 1958. Dadey. 1953, Eriksen, Kuethe, & Sulh- 

vnn 1958 Matarazzo, Saslow, & Pareis, 1958) 

’ More-anxious subjects we found 
communication (Fine, 1957. Jams. 1955), and 

were characterized as more anxious under conditions of stress by Crutchheld 
7lT55f SdC Hunt. Cohen, and Meadow (1954) found more-anxious 
On the other hand 

shown more-anxious subjects to be te 

»d W a^flT)" Thlfwlcers 'showed that more-emotional subject 
were“d Lore persuasib.e when under 

Their study, and others ^^qumug subjects theLsycho- 

seem most relevant to our interest in F,tLuons the subject’s re- 

logical expenment, since in most “P“V ^ pujjjic of the expenmenter 
spouse IS made in the presence of hi ^ (he ^(1960) In his classroom 

Left unexplained are data "xious subjects were more 

drama situation, more-acquiescw (1954) found their less- 

susceptible to social influence Goldberg et at triio 
anxious male subjects to be more in “enc suggestibiUty and 

«■; trf ST— « ^ “”g 

neuroticism or anxiety, Heilizer t i precise measure of 

obtained, and found in his own study, ® neuroticism 

postural sway, no relationship relaUonship between anxiety 

or anxiety In attempting to jp, a vanety of situations we 

and susceptibility to interperson anxiety often makes a dif- 

must settle for the unsatisfying whether more or less anxious sub- 

ference but we cannot accurately predict whether m 

jects will be the more influenceable ^^nined relaUonships between 

’ One factor in the ^-l-^'tVLfluent pmce'ses. generally, may 
anxiety and susceptibility to s relationship This curvilineanty 

be the curvilinear nature of the ® f although admittedly we may 

appears clearly in our own ® jpnal’influenccability Another fac- 

be dealing with a special case of -nuivocality of relaUonships is the 

tor possibly contributing to the obtain 9 14.5 suggests that 

^ ^oT^mpnter Inspecuon 
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ploying the same task, were designed in part to bnng further evidence to 
bear on the question raised by Fode In these studies, anxiety was also 
defined by MAS scores or by a near relative Experimenters and subjects 
were again classified as high, medium, or low anxious if they fell into the 
top, center, or bottom third of their sample's distribution of anxiety scores 

TABLE 14-5 


Anxiety Levels Maximizing Expectancy Effects 


experimenters subjects 


/nvesfigotors N 


Fode, 1965 

16 

Persinger, 1962 

12 

RR,GP,KF,1962 

10 

RR,GP,LVK,RM,1963 

29 

RR, PK,PG,NC,1965 

14 

RR,GP,RM,LVK,MG, 1962 

29 

Vikan-Kline, 1962 



Level 

p 

N 

Level 

p 

Medium 

001 

167 

Medium 

04 

Low 

05 

43 

Low 

07 

High 

.13 

_ 

_ 

- 

High 

.05 

200 

High 

12 

Medium 

08 

28 

High 

05 




and 





low 


Medium 

.08 

86 

High 

10 

- 

- 

75 

Medium 

06 


nic« ^ ' summarizes the results of all seven studies In three sam- 

Lt medium anxiety level was associated with the great- 

and in nn^ c expectancy In two samples, high anxiety level 

ancv effpptc ! °T associated with greatest expect- 

tisUcallv m findings must be regarded as significant sta- 

pattern^empropl^ ^ remarkable inconsistency A similarly chaotic 
subjects found t''" k" consider the results for samples of subjects Those 
were found to h h susceptible to experimenter expectancy effects 

samples and ^'^h-anxious m three samples, medium-anxious m two 
statisticallv sio samples All these results also tended to be 

anrsub,eL ^ only that experimenters' 

1“ -1 -p— "« 

other areas of tp^^ "’^^ched m equivocality by the results from 

The rcIntinnQh susceptibiUty to interpersonal influence 

or a next of lin » usually defined by scores on the MAS 

. o in uenceabihty has been rather frequently investigated 
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contact between expenmenter and subject and maximize ^e physical 
distance between them, it was thought that expectancy effects ^ 

most trivial Pflugrath employed nine experimenters, all graduate student 
rlnselmg and guidanL, to administer the Taylor Manifest An«ety 
Scale (MAS) to 142 students enrolled in introductory psycho ogy, 
whom Varalready taken the MAS on an earher occasion Three of the 

r”old .Jlbms"'*”! >“ •"'■1'“ 

MAS .o 

m each group ranged from 5 ‘o 10 ™th counsel- 

“CiJi «. - rr 

anxiety scores earned by the sub] oercent sLwed a decrease in 

Among the subjects of the contra p P> P ^ ,],c subjects whose 

anxietyscorefromthenpretes level (P >J^ 0 ) Among^^_^^ ^ 

experimenters believed them m b ^^P^^ expenmenters be- 

crease in anxiety (p = 30) Amo g ^ a decrease in anxiety 

heved them to be highly P experimenters were counselors-in- 

(p < 005) When we recall ‘ha .^ey would be testing very 

training this result seems reasonab , 355 , stance at the counsehng 

anxious subjects who had m‘l“‘‘® ' brought all their counsehng skiffs 
center, these experimenters may subiecls’ anxiety This unpro- 

to bear upon the challenge of re u ® ^gaters may operate more fre- 
grammed “therapy” by psycholi^ica p believe In a good deal 

quently in behavioral research than ^ apposed to condiUons 

of contemporary behavioral the effect, on the outcome 

believed to make them ^^art terapeutic zeal and/or skill of van- 

of experiments of this sort, oft ^cpjirrh*? Might certain investigators 

ous investigators carrying out * J® ^ ,,,ay unwittingly tend to dilute 

typically conclude “no diffetenc conversely, might others be led to 

the effects of treatment conditions A ani„,JnUonaffy increasing the 

conclude “significant difference y ..^ore anxious condition” of an 
anxiety of subjects known to hemig , affects of expenmenters’ ex- 

expenmenfi Clearly these are anUr attributes which may have 

ANU SV«ECr WD FOR APPROVAL 

t uy Crowne and Marlowe 
A very extensive senes of expenjnen j^aaa of the approval mo- 
(1964) and their co-workers has shown P 
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effects IS low-anxious, chances are that the more susceptible subjects will 
also be low-anxious The correlation (rho) between the level of anxiety 
characterizing most biasing experimenters and the level of anxiety charac- 
tenzing most susceptible subjects was -1- 64 Although this correlation was 
not significant statistically (p = 18, two-tail), based as it was on only six 
samples, the potential implications are important enough to warrant further 
consideration In research on experimenter expectancy effects and possibly 
in other research dealing with more traditional situations of interpersonal 
influence, the influence process may proceed most effectively when the 
source and target of influence are more alike in level of anxiety Anxiety 
similanly or perhaps nondissimilanty may be a correlate of rapport just 
^racial and religious similanty often seem to be (Hyman et al , 1954) 
^en the variables of experimenter and subject hostility were employed, 
arason (1962) also found the greatest influence exerted upon subjects 
when experimenters and subjects were similar He too employed an 
in erpretation of expenmenter-subject similarity Even if the hypothesis of 
siml^ty or of nondissimilanty were upheld by further research, we would 
♦ problem of accounting for the differences in the absolute 
easilv noJ't'** ^ associated with maximal interpersonal influence We could 

was about ‘n Table 14-5 the situation 

In timf u, ** likely to be in social psychological research 

tionshiDs het’u, ° ^ developing structunng of the complex rela- 

mant T " Processes and the\nxiety stams of the 

tawe shlld logistics point of vtew, 

the necessary expenments to provide 

un equivoc^hvn^h information When seven experiments yield only 

plexity? domain of data charactenzed by such com- 

predictor of suscemiMu '*' 1 '' of anxiety is only a poor 

find It hard to trea/siih ^ ° 1™''* *"®“once may be that expenmenters 
equivalent manner There 

perceptne to hr rhir » j ^'”''0 experimenters who are sufliciently 

■o treat them diS r ou ">o “nxiety levels of their subjects and 

their anxiety level If ^ ^“"'fion of their involuntary assessment of 
cluiracterisncs 0 re lo, of anxieiy (or in other 

same expenment an similarly, they cannot be said to be in the 

expenment by Pfiuerath ohapters An 

do treat their suhn^tc n tr ™£gests that at least some expenmenters 
subjects differently as a function of their perceived anxiety 

mentcr expcciancv^n' Pfiugrath s study was to find out whether experi- 
sonality tesuna operate under conditions of group per- 

se group tesung situations minimize personal 
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tions tended to be more negative than positive (p < 05 , two-tad) Experi- 
menters at a medium or unclassified level of anxiety thus showed greater 
expectancy effects if they scored higher on need for approval (median 
rho = -t- 62 ), whereas expenmenters at either high or low anxiety levels 
showed lust the opposite relationship (median rho = - 40 ) Why this 
should be IS not at all clear, and just as in the case of expenmenter ^ 
subject anxiety discussed in the preceding section, we may guess ‘hat it 
taki considerable effort to impose a structure upon ths ^ ° 

data At any rate, our findings do suggest that, at least for some situah™ - 
t prel^e po^er of the M-C SD scale may be stiff further increased by 
controffmg for the mfluencer’s level of anxiety 

that e^peL'eTersconngTrh "P^^'^een repTr^rby 

mvestigators who unintentional influencers without 

menters might simply be more “ff , ,„vestigatois any more than 

their necessarily wanting to * P j^P^ ^oth rf these mechamsms 
the lower need approval expenmenters 

might reasonably be expected to operate jiterature relatmg need 

It could well be argued, on th v have expected any 

approval to soaal influenceabihty, lha „Dectancv effects and M-C 

particular correlation between expenmen need-approval sub- 

SD scores In the more usual expenment, it s the high 

ject who makes the confommg conform to our demands, must 

studies, the expenmenter-subject, in o . , jjg ,s able to conform, 

successfully influence other, ^“hordmate subj^e^J^ He is 

then, only in an indirect and extreme^ influence their subjerts’ 

Given samples of expenmen . . sconng higher in need for 

responses, we might expect that t ose samples of subjects 

approval would be more need for approval has consistently 

was this hypothesis confirmed S J , , _ ( expenmenter expectancy 

been found unrelated to degree ff“f *fsU,le, unintended social in- 
effects It appears that suscepUbi i y jedictable from subjects’ need 

fluence of a biased expenmenter is elearlv intended forms of inter- 

for approval as is susceptibility to more clearly 

personal influence 


EXPERIMENTER-SUBJECT ACQUAINTAN 

Were there such a thing as ® ‘y^th^Ta'TuMcqLmM^ with all 
would be likely to involve an expenmenter w 
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live to our understanding of susceptibility to interpersonal influence Higher 
need for social approval as defined by scores on the Marlowe-Crowne 
Social Desirability Scale (M-C SD) and related measures (Ismir, 1962, 
Isinir, 1963) usually (Buckhout, 1965), but not always (Spielberger, Ber- 
ger, & Howard, 1963), charactenzes those subjects who comply more with 
expenmentally vaned situational demands 

The eight samples of experimenters for whom expectancy effects were 
correlated with need for approval (M-C SD) are identified m Table 14 6 

TABLE 14-6 


Need for Approval and Expectancy Effects at Three 
levels of Anxiety 


ANXIETY LEVEL 


Investigators 
Fode, 1965 
Marcia, 1961 
Persinger, 1962 
RR,GP,KF,1962 
RR,GP,LVK,RM,1963 

Sample I 
Sample II 

RR,PK,PG,NC,1965 
RR,GP,RM,LVK,MG, 1962 


Nigh Medium Low 


N 

Rho 

N 

Rho 

N 

Rho 

4 

-25 

8 

+ 80 

4 

-80 

- 

- 

13 

+ 74 


- 

- 

- 

12 

+ 58* 


_ 

4 

0 00 

4 

+ 95 

4 

- 40 

4 

- 40 

4 

+ 65 

4 

- 85 

5 

+ 07 

7 

+ 15 

5 

+ 13 

(14) 

(- 55)** 

14 

- 55 

(14) 

(- 55)' 

6 

-60 

9 

+ 21 

10 

+ 25 




tionship depended UDon'*?he*’ '* evident that the nature of the reh 

therefore the con-piL ^^penmenter’s level of anxiety In Table ]4-( 
fects and* M-C SD sco°"* etween degree of experimenter expectancy el 
low levels of cxnenmf'T* ^^hulatcd separately for high, medium, an 

"as not ^sS and 2' "^hod of analysi 

fied as medium anxiety sample of expenmenters was then classi 

but one of the"coStions waf samples of experimenters, al 

dte high- and lowr„L.ous sampler = 

fnpics of experimenters, however, the corrcla 
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their subiects were acquaintances. The effects of acquaintanceship in tHs 
analysis iere. if anything, underestimated because ^ 
of “acouainted ” An experimenter who had only said hello to a subject 
1 sTe earfo occasion was classified as acquainted. Even passing ac- 
ouaintanceships may be nonrandom in ori^n, and it may be that wilhngn 
?rb“eSy the acquaintance is a factor in the ongination of the 

Sit,. TO. '"lyr 

value of an acquaintance demonstrated by i i„,e„er- 

the possibly greater ability of acquainteds to each others interper 

sond signals, may best account for the ^ the 

A subsequent experiment was designed to ded more exp y 

relationship between acquaintances p an P ^ undergraduate 

(Persinger! 1962). Five male 

students served as expenmenter , „,£ent Half the experimenters 

erted significantly "Pool^oLt^. < = 2-64,^/ = 29). This did 

unacquainted subjects (p — -Ubb. • ^ j ^ tendency, 

not mi for female experimenters, howev^^ faeh 

though not significant, tor interpretation of acquaintanceship 

effects with unacquainted s“bjecu. appUcable only to male expen- 

dynanucs offered earlier, *cretore fa/recenUy reported a case in which a 
menters, though Silverman (19 ) estimation, had her hy- 

female experimenter, working m ... her^own students, but discon- 
pothesis confirmed by acquamted 
Lned, and significanUy so, by unacquainted subjec 


EXPERIMENTER STATUS 

rnllected by experimenters dif- 
Data in the social sciences ^pm by their subjects. The 

feting greatly in the status or graduate research assistant 

distinguished professor, the new ms .^,3 „„ gfcale of status consensudly 
the able undergraduate, aU . P .jthin the academic world. Simlar 

ascribed them by virtue of their po^' pUuien,. industrial, military 

status scaling for potential The general question of 

and survey .^search settings 3 ,e,us makes a difference wath 

concern here is whether the expeti ^ ^ppUpg voth sev 

respect to the results of his ^search. ^ that suggested 

eral experimenter attributes, some 
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or most of his subjects There are numerous situations, however, when a 
major proportion of the subjects are acquaintances of the experimenter This 
IS often the case with pilot studies and follow-up studies It is also likely to 
be the case where an experimenter-teacher employs his intact classes as sub- 
jects or when the experimenter is located at a smaller college, clinic, hos- 
pital, or mdustnal setting from which he will draw his subject samples 
Granting only that experimenters sometimes contact acquainted subjects, 
It would be worthwhile to know whether this changes the likelihood of the 
operation of expectancy effects This question would, in fact, be of interest 
even if no experimenter ever contacted a pnor-acquainted subject Acquaint- 
anceship, itself, IS an inevitable result of an expenmenter-subject interac- 
tion, and the degree of acquaintanceship vanes directly with the time and 
intensity of the expenmenter-subject interaction sequence The longer an 
expenment lasts and the greater the information exchanged, the more 
acquainted will the participants be at some point in the sequence, e g , its 


Although acquaintanceship cannot readily be ehminated, it can and 
has been expenmentally varied In an earlier chapter several such studies 
were cited, and it was found that subjects’ performance might be affected by 
collector The study by Kanfer and Karas 
Uysy; IS most relevant to our interest here They found that prior ac- 
quaintance with the experimenter increased subjects’ susceptibility to the 
the experimenter’s reinforcing verbal behavior These findings, 
thn!l cnK * comprehensive work of Newcomb (1961), suggest that 
TTior#* acquainted with their expenmenters should be 

case of expectancy effects This might be even more true in the 

the ^ vious, unintended influence processes Where the cues to 

to have til ^ poorly programmed, the acquainted subject would seem 

Itby t^e 

anceshin anH obtained beanng on the relationship between acquaint- 
tn expectancy effects were incidental to another 

Mulrv 19631 T (Rosenthal, Persinger, Vikan Kline, & 

of photo rptinoc”«f expenmenters were asked to predict what sort 

their SIX random! failure they would subsequently obtain from 

defined by the comlabontrholbT expectancy effect was 

obtain and the data they later expected to 

of their suhrertc ° previously acquainted with one or more 

Iv on dat oL? one or mL o£ their snbjects Based 

exnenmpnt^.rc’ oa i he analogous correlation based on these 

SanTv^^^^^^ Cp= 04,two-ta.I) Thus ex- 

pera ed for this subsample of expenmenters only when 
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TABLE 14-7 


Expectancy Effects as a Function of Experimenter's 
Status 


EXPERIMENTER 

STATUS 




Student 

Faculty 

Difference p 

ORDER 

OF 

SUBJECT 

First half 
Last half 

- 12 
-75 

- 88 
+2 42 

-76 NS 

+3 17 01 


Difference 
Two‘tail p 

-63 

NS 

+3 30 

01 



Th,. ..»d » d. 

presented m the earlier chapter on „,,mpnters went on to collect 

obtained initially “poor” data these exi« returns effect had been 

“worse” subsequent data The studies o J ^ rpj^e early returns 

based on samples of Poss'bly they 

effect may be less likely to occur ^ ^ produce the desired effects 

were less threatened by their eatli y P techniques of 

and were thus freer to learn from their ear y j 

influence might be most effective cvnerimenters tended to employ 

What techniques were employed E p ,l,at portion of 

several In reading the instructions t ey contained reference to the 

the descnption of the photo-raUng sea flyecce positive ratings, they 
desired responses If they were trying “accepting" They 

were fnendlier in general, smiled more, , , negative ratings When 

behaved in cooler fashion when “T"'® caore likely to look in- 

they obtained responses of the desire ^P jort of reinforcement 

terested and pleasant, sometimes * however, that we can regard 
behavior was not so consistent nor so ’ Unfortunately no differ- 

this study as one of typical operan co behavior were foun 

ences in self description of attemp e successful 

between those expeimenters who were and those w 

mfluencers , . npree quite well with the 

In general, the results of ““s ^Coffin, 1941, ’ 

literature relating status to influemia ^ j 95 U Lefkowitz, Blak^ 

Goranson, igedfHomans, 1961.Hovbnd^J;;;^’^ Ruven & 

& Mouton, 1955, Mausner, 1953, 195 . ^ „{ situations. 

French, 1958, Wuster, Bass, & AIcoc . chapter, people with high 

some of which were summanzed in 
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that expenmenter status could, in fact, be a partial determinant of the data 
he obtained from subjects The more specific question then becomes whether 
expenmenter status is a factor m the operation of expenmenter expectancy 
effects Do higher status experimenters obtain data more m accord with their 
expectancy than do lower status expenmenters'^ It was to this question that 
the following study by Vikan-Khne (1962) was addressed 

Six male faculty members and six male graduate students served as ex- 
perimenters Since all were psychologists familiar with research on experi- 
menter expectancy effects, the expectancy-inducing procedure employed in 
earher studies could not be used Instead all exper im enters were asked to 
somehow subtly influence half their subjects to rate photos as successful and 
influence half their subjects in the opposite direction There was a total 
of 85 introductory psychology students who served as subjects About half 
were males 


Before any subject was ushered into the research room, the experi- 
menter was informed whether he should try to influence that subject to give 
ratings of success or of failure No instructions were given as to how to 
1 uence the subjects Indeed such instructions could not be given, since 
no one knew how this subtle form of interpersonal influence was mediated 
subsequent to the data collection, expenmenters’ verbal 
^ ow they tried to influence subjects could be used as a source of 
research Perhaps those who proved to be more suc- 
mTut l^^ving used different tech- 

m that Although this study differed from others in the program 

It was honcH aware of trying to influence their subjects, 

might be s™,hr!fl‘esL”ert *’3' “"mtentional mfluencers 

Ulty nor Ka'duate*'r h'* whom knew neither the fac- 

card plarad ' ''‘P™"' «"‘ers. the definition of status was a name 

words “psvcholotT*^ ^yenmenter's desk The graduate students had the 
cxpenmStf th^r ^eir names The faculty 

names All expenmenterrhL f psychology” written under their 

of 14 colleanies ti, *° apparent age by a sample 

student group (early to m rf member of the graduate 

larIy-Ie^wL^:h:4;ues™ nCS 

Results showed that the 

influencing their subjects to vielH ^ were more successful at 

contacted later m the expcnment V *1“'" ™'y 
the senes of subjects, the^faculty exne 

cessful infiuencers than the craLUrT^f"'"" anything, less suc- 

graduate students never L 'd' 

cncy for them to grow less innuenh^fr, ^ 

nlial later in the senes of subjects con- 
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experimenters with lower ascribed status who showed the greater expectancy 
effects, regardless of the level of their subjects’ dogmatism (p < .05, two- 
tail). 

Perhaps the subjects of this experiment felt sorry for the experimenter 
who was “just a student” and, therefore, were more willing to be influenced 
by him. In any case, it appears from this study that the status effects ob- 
tained by Vikan-Kline were probably not due to the labeling of her experi- 
menters as students or as professors. More likely, the different appearance 
of her high and low status experimenters and possibly differences in the de- 
gree of self-assurance shown by her faculty and student experimenters 
accounted for her findings. 


CHARACTERISTICS OF THE LABORATORY 

Riecken (1962) has pointed out the potential importance to the results 
of psychological research of the characteristics of the laboratory in which 
the experiment is conducted, ft seems reasonable to suggest that the room 
in which the subject is contacted by his experimenter will convey informa- 
tion to the subject about the sort of person the experimenter might be. If a 
tour is undertaken of research rooms and offices used by graduate students 
and faculty members in a university setting, great individual differences may 
be observed. Some rooms look impressive, some look very professional, 
some very comfortable, some inordinately neat or bare. While room charac- 
teristics may reflect the status of the occupant, the occupant may also de- 
rive certain characteristics in the eyes of his subjects from the scene in 
which the experimental contact occurs. The experiment to be reported now, 
conducted in collaboration with Suzanne Haley, was designed in part to 
vary characteristics of experimenters by the variation of the scenes in which 
they contacted their subjects, 

A total of 16 experimenters administered the standard person percep- 
tion task to a total of 72 female undergraduate subjects. Most of the ex- 
perimenters were males and enrolled either in the Harvard Law School 
(N = 9) or in the Harvard Graduate School in the area of the natural 
sciences (N = 7). Each experimenter expected half his subjects to perceive 
the photos of faces as quite successful and expected half his subjects to 
perceive them as quite unsuccessful. In an effort to reduce the overall mag- 
nitude of experimenter expectancy effects, a screen was placed between 
experirnenter and subject so that during the course of the data collection they 
could not see each other. In order to control for experimenter recording 
errors, subjects recorded their own responses. Finally, in order to eliminate 
the effects of early data returns, experimenters were not permitted to see the 
responses made by any of their subjects. 

The experimental interaeflons took place on a single evening in eight 
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status are more likely to influence others successfully If we can generalize 
from this literature and from the expenment reported, it appears that the 
higher status expenmenter, in part because of his greater competence, more 
markedly affects his subjects’ responses into the direction of his hypothesis 
We shall have more to say about this formulation a little later For now 
It IS interesting to note that Pfungst (1911) had also found a relationship 
between the questioner’s status or “air of authority” and the hkelihood of 
his getting the correct response from Clever Hans Even with a horse as 
subject, unintentional influence was more hkely when the expenmenter was 
more self-assured 

In the experiment by Vikan-Khne the status ascribed the expenmenters 
was confounded with their age, with their actual status, and possibly with 
the techmques of influence employed It would be useful to a clearer under- 
standing of the effects of status per se to have an expenment in which the 
status of the same expenmenter was vaned expenmentally and without his 
nowledge The expenment by John Laszio, referred to in an earlier chap- 
fia' experimenters to administer the photo-rating task to 

64 subjects Half the time experimenters were led to expect ratings of sue- 

I"'’ ‘■‘““’gs 

( 5; Half the subjects in each of these conditions were told that their ex- 
penmenter was just a student,” and the remaining subjects were led to 
oSm ® experimenter was of higher status The subjects had all been 
ministered Rokeach’s (1960) scale of dogmaUsm Table 14-8 shows the 


TABLE 14-8 


Expectancy Effects as a Function of Experimenter's 
Status and Subjects' Dogmatism 


experimenter 

STATUS 




High 

Low 

Difference 

SUBJECTS' 

dogmatism 

High 

Low 

+ 83 
- 88 

+ 1 69 
+ 09 

- 86 
- 97 


Difference 

+1 71 

+ 1 60 



expenmenter and the sabjeL level h 

showed a greater suscepubthty to thfex^"" 

as had been expected (p < 05 twwadre"'""'’"" 

t' / V. , iwo-tail) Surpnsingly, however, it was the 
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on his subjects. For both samples of experimenters, the greater the disorder 
in the experimental room, the greater were the effects of the experimenters’ 
expectancy. We saw in the last chapter that expectancy effects were likely 
to be greater when the experimenter was perceived as more likable and more 
personal. The disorderliness of an experimental room may have relevance 
to this dimension of interpersonal style. None of the rooms were disorderly 
to a chaotic degree. Within these limits the more disorderly room may be 
seen as reflecting the “living” style of a more likable and more personal 
experimenter. 

At the conclusion of this experiment, the experimenters were told 
about the phenomenon of expectancy effects, shown published articles 
describing some of the earlier studies, and asked to repeat the experiment 
with a different sample of 86 female subjects. In this repetition of the 
experiment no screens were placed between the experimenters and their 
subjects. Half the experimenters were asked to try to avoid the operation of 
expectancy effects, half were asked to try to maximize them. Within each 
of these conditions, half the experimenters were told that in the original 
study they had shown significant unintended influence. The remaining ex- 
perimenters were told that they had shown no real expectancy effects. 
Table 14-10 shows the mean increase of expectancy effect for each of the 

TABLE 14-10 


Increase in Expectancy Effects for Four Kinds of 
Experimenters 


ORiENTATiON TO 
EXPECTANCY EFFECT 


f/uence "History" 

Maximize 

Minimize 

Difference 

“Successful” 

infiuencer 

+1.08 

+0.23 

+.85 

“Unsuccessful” 

infiuencer 

+ 1.33 

+0.41 

+.92 

D;f/erence 

-.25 

-.18 



four experimental conditions from the first study to the replication. Experi- 
menters who were trying to influence their subjects showed significantly 
greater expectancy bias than did experimenters t^ing to avoid expectancy 
effects ip < .05, two-tail). (Somewhat surprisingly, however, even the 
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different rooms to which expenmenters were randomly assigned Most of 
these rooms served as offices for psychology graduate students and faculty 
members Each room was rated after the expenment by all 16 expenmenters 
on the following dimensions 

1 How professional is the room in appearance*^ 

2 How impressive is the room, i e , what is the status of the person 
who normally occupies it*^ 

3 How comfortable is the room, especially from the subjects point of 
view‘d 

4 How disorderly is the room‘d 

Ratings were made on a scale ranging from zero (e g , not at all pro- 
fessional) to 10 (eg, maximally professional) The first three scales were 
found to be highly intercorrelated (mean rho = -1-78), and a single scale 
of status was constructed by summing the scores on all three scales for each 
room The mean rehabihty of these three scales was 89 The scale of dis- 
order showed a correlation of only 29 with the combined status scale 
and showed a rehabihty of -{- 99 

Table 14-9 shows the correlations of room status and room disorder 

TABLE 14-9 


Correlations Between Room Characteristics and Ex- 
pectancy Effects 


Experimenters 

No of Rooms 

Stofus 

Disorder 

Law students 

7 

+ 64 

+ 61 

Graduate students 

6 

+ 48 

+ 89 

Weans 


+ 58 

+ 77 

Two-foi/ p 


10 

.02 


with magnitude of experimenter expectancy effect Magmtude of expectancy 
effect was defined, as before, as the difference between mean ratings ob- 
tained from subjects belie\ed to be success perceivers and those beheved 
to be failure perceivers The law student and graduate student expen- 
menters are hsted separately because the latter group showed significantly 
greater expectancy effects that did the former For both samples of expen- 
menters, the higher the status of the room in which the subject was con- 
tacted, the greater were the expectancy effects This finding adds to our 
confidence m the h>'pothesis that, with the exception noted earlier, the 
higher the status of the experimenter, the greater his unintended influence 
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experimenters the correlations tended simply to go toward zero. Among the 
graduate students, however, they tended to go into the opposite direction. If 
it is reasonable to think that our more science-oriented graduate students 
were trying to avoid the spoiling effects of their expectancy bias, the re- 
versals of the correlations make sense. The higher status and more dis- 
ordered rooms, then, still predicted the biasing effects of the experimenter’s 
expectancy, only now the science-oriented graduate students expected, and 
hoped, to obtain data opposite to that which they had been led to expect. 
Their ‘Teal” expectancy may have become that which would avoid the 
effects of the induced expectancy, and subjects were more inclined to go 
along with these, now reversed, unintended communications in the higher 
status, more disordered laboratories. 
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expenmenters trying to avoid them showed a tendency to increase their 
expectancy effects when the screens had been removed, p < 20 ) 

Those expenmenters who had been told that they had shown no ex- 
pectancy bias- tended to show a greater mcrease in expectancy effects than 
did the expenmenters who were told they had shown expectancy bias (p = 
11, two-tail) Perhaps those expenmenters who believed they had biased 
the results of their first study felt chastised for it and made some special 
efforts to retard the communication of their expectancy to their second set 
of subjects, even when they had been instructed to maximize expectancy 
effects 

When the changes in magnitude of expectancy effect from the onginal 
to the rephcation study were examined separately for law student and gradu- 
ate student expenmenters, an interesting difference emerged Among law 
student expenmenters, 66 percent of the subjects were more influenced in 
the second study than in the first (p = 02, = 6 25), disregarding the 

particular expenmental conditions Having learned about subtle commum- 
cation processes between the time of the first and second samples, young 
lawyers may have felt it desirable for attorneys to be able to communicate 
subtly with other people 

Among the graduate students, most of whom were in the sciences, the 
subtle commumcation process may have been not only less prized but per- 
haps even abhorred as a cause of spoiUng experiments Regardless of their 
expenmental condition, these young scientists showed a significant decrease 
in ex^ctancy effects in the second study Of their subjects, 73 percent were 
l«^s^biased than were the subjects of their first sample (p < 05, x* = 

In the second stage of this expenment, laboratory room charactenstics 
frnm T K? magnitude of expectancy effects As can be seen 

. ^ correlations obtained earlier were not rephcated un- 

er e con itions of the second phase of the study Among the law student 


TABLE 14-11 


Room Characteristics and Expectancy Effects- Sec- 
ond Sample of Subjects 

Experimenlers No of Rooms S,a,as Disorder 


Law students 
Graduate students 


- 07 

- 30 


+ 25 
- 90* 


P < 05, two-totl 



Behavioral Variables 


251 


TABLE 15-1 


Cluster Analyses of Four Samples of Subjects' Per- 
ceptions of their Experimenter's Behavior 


/ 


Invesfigaiors 

Cosuol 

Pleasant 

RR,KF,JF,LVK,-I960 

6.48 

RR,GP,LVK,RM,1963 

Sample 1 

4.43 

Sample II 

1.69 

RR,JF,CJ,KF,TS,RW, 

LVK,1964 

0.67 

Meon 

3.32 


CLUSTERS 


II 

Expressive 

Friendly 

III 

Kinesic 

Cluster 

IV 

Enthusiastic 

Professional 

3.97 

9.10 

3.55 

3.00 

2.33 

-3.77 

4.86 

-0.58 

0.33 

6,01 

9.12 

-2.73 

3.83 

4.83 

0.14 


Table 15-1 lists the clusters and B-coefficienls of the original study as well 
as those of the later experiments. A B-coefficient greater than 1.5 may be 
interpreted as indicating a significant cluster, and a B-coefficient of 3.0 indi- 
cates a relatively tightly intercorrelated set of variables. The mean B-coeffi- 
cients for the four studies show that the first three clusters held up quite 
well, but Cluster IV, composed as it was of only three variables, tended to 
vanish. The first three clusters may prove to be a useful way of organizing 
subjects’ perceptions of their experimenter’s behavior in future studies. 
They may also be of value in other investigations of interpersonal percep- 
tion. They have not, however, proved themselves related to magnitude of 
experimenter expectancy effects in most of the studies carried out. 

For five samples of experimenters, their subjects' perceptions of their 
behavior were correlated with the degree to which the experimenters ex- 
erted expectancy effects upon their subjects. Experimenters who obtained 
data closest to that which they bad been led to expect were ranked as 
most biased. Those who obtained data most unlike that which they had 
been led to expect were ranked as least biased. Three samples of experi- 
menters employed the photo-rating task in which each experimenter con- 
tacted his subjects individually (Rosenthal, Fode, Friedman, & Vikan-KIine, 
I960; Rosenthal, Persinger, Vikan-KIine, & Mulry, 1963). The data for 
the first sample were those presented in the chapter dealing with the effects 
of excessive reward. A fourth sample of experimenters also employed the 
photo-rating task, but the experimenter contacted subjects in groups of five 
(Rosenthal, Friedman, Johnson, et al., 1964). The fifth study employed a 
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In the last chapter a number of expenmenter charactenstics were 
shown to be related to the operation of expenmenter expectancy effects The 
particular charactenstics discussed could all be assessed before the experi- 
menter entered his laboratory In this chapter, the discussion of experi- 
menter variables wiU continue, but now the emphasis will be on the 
experimenter’s behavior in his interaction with the subject Much earlier, in 
Part I, we saw that various structural vanables such as the sex of the ex- 
penmenter were correlated with the behavior of the expenmenter as he 
interacts with his subjects The behavioral vanables to be discussed in this 
chapter, therefore, are not independent of the more structural variables dis- 
cussed in the last chapter, but they do warrant special attention The com- 
munication of expectancy effects to subjects must depend on something 
the expenmenter does If experimenters of a certain kind, as measured be- 
fore the experiment begins, exert greater expectancy effects on their sub- 
jwls. It IS very likely due to their behaving differently toward their subjects 
Ihe observations of the expenmenter’s behavior to be discussed now come 
from two major sources The first of these sources is the direct observation 
of expenmenter behavior usually by the subject himself The second of 
these sources is the observation of experimenter behavior by a variety of 
observers of sound motion pictures of expenmenters interacting with sub- 


DIRECT OBSERVATIONS OF EXPERIMENTER BEHAVIOR 

In the chapter dealing with the effects of excessive rewards, some pre- 
hmin^ data were presented which gave some idea of how subjects per- 
ceived the behavior of their expenmenter The subjects’ ratings of their 
experimenters behavior were intercorrelated and cluster analyzed (Fruch- 
ter, 1954) In three subsequent expcnmenls, this procedure was repeated 
250 
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menters It may be that more professional-mannered experimenters tram 
their assistants to be more professional-mannered and therefore more 
influential In this study, which has already been referred to (Rosenthal, 
Persinger, Vikan-Klme, &Mulry, 1963), research assistants were randomly 
assigned to investigators In the real-hfe situation, selection factors no doubt 
combine with traimng effects to make research assistants and other col- 
leagues more like each other than would be true of any random set of 
expenmenters This diminished variability due to selection and training may 
serve to make the results of research coming from any laboratory less 
vanable than we would expect from randomly chosen expenmenters, even 
with techniques of research held constant 

The correlation between experimenter expectancy effects and “expres- 
sive voice” suggests that part of the commumcation to the subject of what 
It IS the expenmenter expects him to do is earned by the inflection and tone 
given to the verbal instructions to subjects Similarly, the correlation 
between expenmenters^ expectancy effects and use of legs suggests that 
movement or kinesic patterns also play a role in the mediation of expen- 
menter expectancy effects (and in other situations of interpersonal in- 
fluence as well, as Birdwhistell, 1963, has suggested) Why leg movements 
m particular should serve this function is not at all clear All expenmenters 
have been rated by their subjects as showing relatively few movements of 
any sort In particular, leg movements are the least frequent of the infre- 
quent movements Perhaps because they are rare, very minor leg adjust- 
ments are more noted by subjects and responded to Exactly what sort of 
leg adjustments are employed unintentionally by the expenmenters, and 
what their immediate effect on the subject might be, is a question for further 
research 

The variables just discussed were those which held across all five 
samples of experimenters When we omit the verbal conditiomng sample, 
leaving us only those samples in which experimenter influence was more 
likely to be purely unintentional and in which the photo rating task was em- 
ployed, several additional vanabics become signficant Table 15-3 shows 
these additional characteristics That expenmenters who are perceived 
as acting more important should show greater unintended influence is re- 
lated to the more general finding of professional-mannered expenmenters’ 
exerting greater influence The mean correlation of this vanable with 
the vanable “professional” for these samples was -f- 42 For the per- 
son perception task, the use of head movements became an additionally 
possible source of cues to subjects For these samples the mean correlation 
between use of head and leg movements was only -f 26 suggesting that it 
was not simply greater movement but differential movement of body areas 
that served as sources of information to subjects as to what it was the expen- 
menter expected from them For these samples of expenmenters, those who 
appeared more relaxed (vs nervous) were more effective expectancy com- 
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Standard verbal conditioning paradigm, in which subjects were rewarded 
with a “good ’ for the correct choice of pronoun in forming a sentence Al- 
though differential expectancies were created m expenmenters leading 
them, presumably, to emit unintended cues to their subjects, they also were 
intentionally trying to influence their subjects by their contingent saying of 
“good ” In this experiment, therefore, both intentional and umntentional 
influence processes were operating (Rosenthal, Kohn, Greenfield, & Carota, 
1966) In this study, each experimenter contacted his subjects individually 
The average sample size for each of the five expenments was about 20 
experimenters and about 100 subjects 


TABLE 15-2 


Subjects' Ratings of Their Experimenter's Behavior 
and Magnitude of Expectancy Effect Applicable 


Under All Conditions 




Behovior 

r 

df 

p Two-' 

Businesslike 

+ 31 

105 

005 

Expressive voice 

+ 26 

105 

01 

Professional 

+ 25 

105 

01 

Use of legs 

+ 22 

105 

03 


Table 15-2 shows the four vanables that were least situation-specific 
m their correlation with magnitude of expectancy effect None of the corre- 
lations was impressively high, though all held up statisUcally significantly 
over five replications Also heartening was the fact that each of the four 
vanables represented a different cluster As we would expect, therefore, the 
intercorrelations among these vanables were generally low The only ex- 
cep ion to t IS was the mean correlation of -J- 40 between professional and 
Dusinesslike Considenng these two vanables together it appears that for 
a variety of situations of unintended and intended influence, of individual 
ino subjects, m person perception and verbal condition- 

m «■•!' 'he more professional manner is more likely 

nrpspnti»H "" his subjects This finding is consistent with those 

stniiii '"h chapter in which expenmenters with higher 

fubjects^ reTpti’ses'*™'^ determined, showed gremer influencing of their 

. n extension of this finding was possible from one of our 

studies Subjects ratings of how professional their experimenter appeared 
correlated significantly (+ 59, p = 05. two-ta.l) w.{h the degree of ex- 
pectancy effect exerted by the investigators who had trained these experi- 
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would likely be seen by their subjects as not too businesslike or professional. 
At lower levels of this variable, enthusiasm is related strongly to degree of 
experimenter interest (r = and significantly, but less strongly, to 

professional manner (r = 4-.35). 

When we consider only those three samples of experimenters who in- 
fluenced their subjects only unintentionally and in a face-to-face interaction, 
two additional variables emerge as related to degree of expectancy effects. 
The more important of these was the variable "personal-impersonal.” Most 
experimenters are rated as neither very personal nor very impersonal, but 
a bit toward the latter end of the scale. Among these samples of experi- 
menters, those who exerted more unintended interpersonal influence were 
perceived as significantly more personal (r = 4- .46, df = 27y p = .02). 
That more “personal” experimenters should be more influential makes 
rather good sense, given the face-to-face nature of the interaction in these 
experiments. A less sensible finding was that experimenters seen as more 
courteous tended to influence their subjects a little less (r = —.30, df = 27, 
p = .11). On the average all experimenters were viewed as very courteous, 
and ratings on this variable showed the lowest variability (S.D. = 2.2) of 
all 27 variables. Given this high general degree of courtesy it may be that 
extreme courtesy was perceived as aloofness by subjects who were more 
readily influenced by a more personal experimenter. 

In two of the three samples of experimenters we have just been dis- 
cussing, the interaction between experimenters and subjects was monitored 
by another experimenter who had trained the data collector. This observer 
simply sat in on the interaction and rated the experimenter’s behavior on 
the same variables employed by the subjects. Table 15-5 shows the only 

TABLE 15-5 


Observers' Ratings of Experimenter's Behavior and 
Magnitude of Expectancy Effect: Applicable Only 
When Interaction is Dyadic 


Behavior 

r 

df 

p Tvfo-Tatl 

Arm gestures 

-.41 

18 

.08 

Behaved consistently 

+.39 

18 

.10 

Slow-speaking 

+.36 

18 

.13 


three variables that gave promise of showing a relationship with the magni- 
tude of experimenter expectancy effects. Most surprising was the finding 
that those experimenters who were rated as using fewer arm movements in- 
fluenced their subjects more. The surprise was due to the generally high 
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TABLE 15-3 


Subjects^ Ratings of Their Experimenter's Behavior 
and Magnitude of Expectancy Effect: Applicable 
When Influence is Unintentional Only 


Sehov/or 

r 

d! 

p TwO’Tail 

Important octmg 

+.33 

39 

04 

Relaxed 

+.27 

48 

07 

Head gestures 

+ 23 

48 

11 


municators Freedom from tension is consistent (r = -{- 56) with the pic- 
ture of the more professional, higher status experimenter In addition, 
however, this finding suggests that the movement patterns we have discussed 
were not gross, random activity patterns, as we might expect from an 
anxious experimenter, but rather more finely differentiated patterns of 
kinesic activity The mean correlation between “relaxed” and use of head 
gestures was only — 06 

When we omit from our five samples only that sample in which expen- 
menters contacted subjects m a group situation, the additional vanables 
shown m Table 15-4 emerge as significant When contact between expen- 
menter and subject is one-to-one, those expenmenters showing greater 
interest influence their subjects more, regardless of which task was employed 
and regardless of the degree of intentionality of the influence process The 
ower spea mg experimenter probably can better give differential emphasis 
from^ proceedings, thereby giving subjects more information 

Mnn ° ''^**^* responses are expected by the expenmenter 

experimenters are perceived as being very enthusiastic, but 
nrninKi ^ more so, influence their subjects more This would 

P y no e true for samples of overenthusiastic expenmenters, who 


TABLE 15—4 


Subjects' Ratings of Their Experimenter's Behavior 
and Magnitude of Expectancy Effect Applicable 
Only When Interaction is Dyadic 


fiehovior 

r 

df 

p Two-Tail 

Interested 

+.42 

84 

001 

Slow-speakmg 

+ 28 

84 

.01 

Enthusiastic 

+.20 

84 

.07 
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their subjects more were seen as somewhat less honest than the less in- 
fluential experimenters (r := -.33, df = 22, p = .12). In some way, sub- 
jects seem able to sense the process of unintended interpersonal influence 
and evaluate it as undesirable. 

In the verbal conditioning study wherein experimenters were in part 
intentionally attempting to influence their subjects, several additional vari- 
ables bore a relation to degree of experimenter influence (Table 15-6), 


TABLE 15-6 


Subjects' Ratings of Experimenter's Behavior and 
Magnitude of Experimenter Influence? Applicable 
When Influence is at Least Partially Intentional 


Behavior 

r 

df 

p Two-Tail 

Loud 

-.27 

SB 

.04 

Behaved consistently 

+.74 

58 

.07 

Important'OCtlng 

-.22 

58 

.10 


In this situation, compared to the person perception task employed in the 
other samples, all experimenters were very active. They talked (“good”) 
during the process of the subjects’ responding, whereas in the person per- 
ception studies, experimenters served only as recorders during the data 
production phase. Under these conditions of experimenters’ fairly obvious 
attempts to influence subjects’ responses, a louder experimenter might 
have been viewed as a brow-beating influencer who could best be dealt 
with by negative conformity. Tbe more consistent behavior of the more 
influential experimenter is in accord with our evolving view of the more 
effective influencer as the more competent, professional experimenter. The 
most interesting conelation may be the negative relationship between ex- 
perimenter’s influence and the degree to which he acts importantly. This 
relationship is opposite to that obtained under conditions of unintended 
influence. When the experimenter has already assumed the role of im- 
portant reinforcer of desired responses, the stiU more important-acting ex- 
perimenter may be seen as overbearing rather than simply important or 
high status. The “overinflucncer,” the experimenter who seems to push too 
hard, may be a less successful influencer than the more modest, professional 
experimenter who more quietly communicates his wishes to his subjects. 
For this sample of experimenters the correlation between “loud” and “im- 
portant-acting” was -f-.40 Cp < .005). 

From all the data available based on subjects’ perceptions of their 
experimenters, four dimensions emerge that seem relevant to distinguisliing 
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positive correlations among all the movement variables, two of which had 
already been shown to be positively related to experimenter expectancy 
effects A tentative explanation of this finding is that, to an external ob- 
server of the dyadic interaction, excessive movement by the expenmenter 
is interpreted as nonpurposive and, therefore, a reflection of both tension 
and an unprofessional manner Behaving consistently in interaction with 
subjects is one of the qualifications of a competent, professional experi- 
menter The obtained correlation of 39 between behaving consistently 
and exerting expectancy effects upon subjects further strengthens the 
emerging picture of the more competent, professional experimenter’s show- 
ing the greater expectancy effects The slower-speaking experimenter’s 
greater opportunity to convey information to the subject about the expen- 
menter’s expectancy has already been discussed This hypothesis appears 
to hold up regardless of whether the observation of “slow-speaking” is 
made by a participant-observer subject or by an external observer Before 
leaving this section, it must be emphasized that these external observations 
were made in the situation of face-to-face contact between expenmenter and 
a single subject and might not hold for the situation m which several sub- 


jects are contacted as a group 

Because our external observers were older, more sophisticated, and 
more professional, we might be tempted to regard their observations of the 
expenmenters’ behavior as somewhat more “valid ’ than the observations 
made by the participant-observer subjects At this stage of our knowledge 
to make such an assumption seems unwarranted Perhaps because of their 
greater direct involvement and perhaps because of their less sophisticated, 
more implicit theories of human interaction, the subjects’ perceptions of 
their expenmenters may be, in a sense, even more valid than the external 
observer’ PhenomenologicaUy, the subjects were more really present 
dunng the interaction with their expenmenter 

Returning now to subjects’ assessments of experimenters’ behavior, we 
n ^ tional vanables to bear a relation to degree of expectancy ef- 
Itcts In the situation wherein groups of subjects are contacted by an expen- 
r, grea er o y movement by the expenmenter is associated with the 
ewrhon of jpeater unintended influence (r = + 43, df = 22, p = 04) 
infn^nt / e movements of the legs and head may be sufficient to carry 
° ^ when he is alone m his interaction with the expen- 

r, e more gross cues of total body movements may be required to 
rJirf -nformation in the group situation Inffividual subjects 
ndHttinn /h ^ e^penmenler quite as well in the group situation, and, in 
til ' ^ ^ emitting significant interpersonal messages to each 

other via their movement patterns which serve to distract attention away 
from signals emitted by the expenmenter 

In the group situation as m the dyadic, subjects rate all their expen- 
menters as very honest Those expenmenters, however, who influenced 
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One difficulty with the data based on subjects’ perceptions of expen- 
menters’ behavior must be emphasized In all these studies, subjects assessed 
their expenmenter’s behavior after they had made their responses for the 
expenmenter It is possible, then, that those subjects who felt they had been 
influenced by their experimenter went on to describe their expenmenter, 
not as he was, but as he ought to have been for them to have been influenced 
by him If this were the case we would have learned, not what sorts of ex- 
penmenters influence subjects unintentionally, but rather what sorts of 
characteristics people ascnbe to expenmenters to justify their having been 
influenced This too would, of course, be worth knowing In any case, there 
IS no way out of the dilemma created by asking subjects to assess their ex- 
perimenters If we asked subjects to descnbe their expenmenter before they 
respond for him, the charactenstics ascnbed might easily serve as a basis 
for subjects’ “deciding” whether or not to accept the influence of the expen- 
menter The act of having ascnbed high status and personalness to an 
expenmenter may be reason enough for subjects to behave as though these 
attnbutes had a validity independent of their own assessment Dissonance 
reduction cuts both ways 


nLMED OBSERVATIONS OF EXPERIMENTER BEHAVIOR 

Useful as it was to have subjects serve as observers of their expen- 
menter’s behavior, it became apparent that external observers would be 
needed to tell us how the expenmenters “really” behaved when interacting 
with their subjects These external observations would be important in their 
own right, and, in addition, they could serve to validate or invalidate the 
hypotheses generated from the subjects’ observations of the behavior shown 
by expenmenters exerting greater or lesser expectancy effects 

From sitting in on expenmenter-subject interactions it became clear 
that only a fraction of the behavior of an expenmenter could be observed, 
recalled, and reported Pfungst’s (1911) expenence m tracking down the 
cues that questioners gave to his clever friend, Hans the horse, suggested 
too that “just watching” might be too coarse a methodological sieve with 
which to strain out the possibly tiny cues that communicated the experi- 
menter’s expectancy to his subject What seemed most needed was the op- 
portumty to observe the expenmenter-subject interaction, the possibility of 
reobserving it, and, then, observing it again Sound motion pictures seemed 
to provide the best permanent record of how the experimenter behaved vis- 
a-vis his subject Reference to the sound films taken has already been made 
in earlier chapters Now some of the details of the filming procedure are 
reported (Rosenthal, Persinger, Mulry* Vifcan-Kline, & Grothe, 1962) 

There were five different samples of experimenters whose interactions 
With their subjects were filmed All had in common that they employed the 
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experimenters who are more or less bkely to exert the unintended influence 
of their expectancy upon their subjects 

1 Professional status Experimenters who are more important, profes- 
sional, businesslike, and consistent exert greater expectancy effects 
upon their subjects 

2 Interpersonal style Expenmenters who are more relaxed, interested, 
enthusiastic, and personal exert greater expectancy effects upon their 
subjects, but probably only so long as they maintain a professional 
manner, and do not permit the experiment to become a “social hour ” 

3 Kinesic communication Expenmenters who employ subtle bnesic 
signals from the leg and head regions exert greater expectancy effects 
upon their subjects These kinesic signals may still be effective at 
higher levels of overtness if subjects are not paying full attention to 
the expenmenter However, if the kinesic signals become very ob- 
vious, they are likely to lead to a diminution of expectancy effects, 
because they will detract from the professional demeanor of the ex- 
penmenter 

4 Parahnguistic communication Expenmenters who speak slowly and 
in an expressive, nonmonotonous tone exert greater expectancy effects 
upon their subjects The way in which the expenmenter delivers his 
programmed input (instructions, greeting, leavetaking) probably 
serves to communicate his expectancy to his subject 


It IS through the kinesic and parahnguistic channels of communica- 
tion that the expenmenter may convey the information to the subject as to 
what responses are expected The greater professional status of the expen- 
menter who unintentionally influences his subjects more may serve to legiti- 
mize or the subject his conformity to the expenmenter’s expectancy The 
more personal interpersonal style of the more influential expenmenter may 
motivate the subject to want to fulfill the status-legitimized expectancy of 
he expenmenter If the expenmenter becomes subUy bored, tense, or dis- 
n , e su ject may subtly retaliate by disconfirmmg the experimenter’s 
pec ancy even though it may be perceived as legiUmate If the experi- 
vam tb ' Pr°f«sional status m the eyes of the subject, it may be irrele- 
tn eVne t m and personal, he may be viewed as having no nght 

<0 his expectancy If a high status, per- 
the V H cannot communicate effectively through 

herinr h parahngmstic channels, his influence will fail simply 

b™ 1°' •''= expenmenter really expects 

f 1 b ^ ^ some experimenters communicate more ef- 

fectively via the kmesic and some via the parahnguistic channels Similarly, 
some subjects may be more influenceable simply because they are more ac- 
curate decoders of signals sent via the experimenter’s particular channel of 
choice ^ 
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jects involved in each and the number of dyadic interactions that were 
filmed. A description of the five experimental groups follows. 

Group Aj. These experimenters had served as experimenters in an 
earlier study (Rosenthal, Persinger, Vikan-KIine, & Muliy, 1963). In that 
experiment some experimenters had been led to expect either ratings of 
success or of failure from their subjects. In the present study, those experi- 
menters who had earlier been led to ejqject mean photo ratings of -f -5 were 
led to expect mean ratings of — 5. Those experimenters earlier led to ex- 
pect ratings of —5 were now led to expect ratings of -f5. 

Group Aj. These experimenters had also served as experimenters 
in an earlier study (Persinger, 1962). Some had been in a +5 expectancy 
condition, others in a —5 expectancy condition. In the present study, these 
experimenters were led to expect that some of their subjects would give 
photo ratings of -{-5, whereas other subjects would give photo ratings of 
—5. This condition and the preceding one had in common the fact that 
the experimenters had served as data collectors before in the same task. 
On the average, these experimenters had contacted about six subjects in 
their earlier data collection. The subjects contacted by these experimenters 
had all seen the photos to be rated when they were part of a standardization 
group. In the standardization study, subjects were shown the photos in 
their classrooms by means of an opaque projector. 

Group Bg. These experimenters had not served before in the role of 
data collector. Each experimenter's group of subjects was divided into 
thirds. For the first third of his subjects contacted, each experimenter was 
given no expectation as to the photo ratings likely to be obtained from his 
subjects. The second third of these subjects were contacted with half of the 
experimenters led to expect -f-5 and half led to expect —5 ratings. For 
the final third of the subjects, each experimenter was led to expect ratings 
opposite to those he had expected from the second third of his subjects. All 
subjects in this group were females. 

Group B 4 . This group was identical with the just preceding group 
except that when their expectations of -f-S or — 5 data were induced, these 
experimenters were told that the ‘^prediction” of subjects’ ratings depended 
on the experimenter’s following instructions and proper experimental pro- 
cedure. This sentence was intended as a very mildly ego-involving manipula- 
tion. Ail subjects in this group were also females. 

Group B 5 . This group was identical with the one just preceding except 
that all the subjects were males rather than females. For all groups, the 
experimental manipulation of experimenters’ expectancies was as follows: 
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photo-raUng task but differed m the specific hypotheses to which the studies 
were addressed Not including an analysis of the films, the substantive 
results of these studies have been reported in the appropriate chapters of 
this book and, in somewhat different form, elsewhere (Rosenthal, Per- 
singer, Mulry, Vikan-KIme, & Grothe, 1964a, 1964b) 

Altogether there were 24 male and 5 female expenmenters who ad- 
ministered the photo-rating task to 164 subjects, of whom about 75 percent 
were females Of the 29 expenmenters, 24 were graduate students enrolled 
in a course in advanced educational psychology The other 5 experimenters 
(2 males, 3 females) were advanced undergraduates enrolled in psychol- 
ogy courses The subjects were undergraduates enrolled in elementary 
courses in psychology, education, Enghsh, history, and government For 
the students enrolled in psychology courses, serving as subjects was a course 
requirement Subjects from other courses were encouraged by their in- 
structors to volunteer but were not required to participate The subject 
population, therefore, was a mixed group of volunteers and nonvolunteers 
Each expenmenter contacted from three to eight subjects, and the mean 
number of subjects per expenmenter was between five and six 


Experimental Groups 

Table 15-7 presents a summary of the characteristics of each of the 
five expenmental samples, including the number of expenmenters and sub- 


TABLE 15-7 

Characteristics of Five Filmed Experiments 


EXPERIMENT 


Experienced 

^1 

^2 

expenmenter 

Ego involved 

yes 

yes 

experimenter 

no 

no 

Sub|ects’ sex 

mixed 

mixed 

N of experimenters 

4 

6 

N of subjects 

N of filmed 

23 

37 

interactions 

15 

24 


S 3 

64 

B5 

Total 

no 

no 

no 

mixed 

no 

yes 

yes 

mixed 

female 

female 

mole 

mixed 

7 

8 

4 

29 

40 

48 

16 

164 

20 

22 

10 

91 
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camera operator was able to manipulate the camera and f 

same time The other telephone was located m a small room off the su 
jects’ waiting-room area, and both the ^rin'r " 

sat in the chairs intended for expram When permitted 

cate the camera and microphone None ^ere able to 

to approach within a ^ window shutter was fully open. 

ttdte fo:mt”ubiX^^^ could not approach too close to the 

window. left their chairs, and none came 

As it turned out, few expenm . ... jubiect interactions filmed, 

close to the window. Out of the 91 ^ ’ ^yes dwelled on the 

in whole or in part, there were 4 or 5 snl^ects who _ 

bookcase long enough to ma subject router to conduct a 

curred, the camera °P“'‘'°^ ® P , subject. These interviews suggested 
postexperimental interview with 1 experiment 

that while subjects were suspicion . . being observed. Follow- 

was being withheld, none hinte » a ^ bookcase that camouflaged the 
ing these instances of overattenUon looking at the bookcase by 

wiLow, we watched for an sucJi increase. Of course, had 

subsequent subjects. We could observed, their 

SrirtL^brifdCcorcUng interaction would no doubt have been 

-“Si „p.— ».«»> -"“'."K •« d'S 

film capacity of the camera was such th was undertaken 

could be filmed. Systematic sampling jbird, 

with an effort made to film the con‘a 1 subjects contacted 

one from the second third, and ‘^Jud ^hough not perfect, distribu- 

by each experimenter. This resulted . u^ ^ ^ „ „o 

tion of subjects contacted by the p 

expectancy. . jur the camera, and virtually every 

The experimenter was *0 * ,iu,e the subjects face 

frame shows his or her face an b-never the camera “zoomed’ m for 

and trunk were also on camera, subject could not be seen. Be- 

a tighter close-up of the «P^."'"' bservations of their experimenter that 
cause of the finding from subject the camera moved back 

leg movements might be impo ant experimenter and su - 

from time to time so that full le g p 
ject could be obtained. 
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According to several personality tests we have given the (next) subject(s), 
we are able to predict how they will rate the photos ' Some of these subjects tend 
to rate the photos, on the average, extremely high, and some tend to rate them, 
on the average, extremely low The (next) subject(s) that you will run should 
average a +5 (or —5) which is a pretty high (or low) average 

The expenmenters serving in groups Bg, B4, and B5, were assigned to 
these groups at random Within all groups subjects were randomly assigned 
to their expenmenters 


The Filming Procedure 

All experimenters contacted all subjects in the same expenmental 
room This room was very large, measunng about 50 by 20 feet Expen- 
menters and subjects sat near the entrance to this room near one of the 
20-foot walls Their chairs were arranged so that they would be partially 
facing each other and partially facing the far 20-foot wall At a point about 
10 feet from this far wall a sound-insulated wall was constructed, shorten- 
ing the expenmental room and creating a smaller room for the placement 
of a camera 

A Bach Auncon Pro-600 sound movie camera employing Kodak Tn-X 
Reversal Film, tripod-mounted, and equipped with a Pan Cinor “zoom 
ens was the recording instrument The camera was focused on the experi- 
menter and subject some 30 feet distant through an 8 by 8 inch double- 
glassed window built into the specially erected wall This window was 
equipped with a wooden shutter which was operated from the observation 
room n the experimental room the window was camouflaged by a glass 
ron , a se- acked bookcase containing both books and old empty picture 
frames These frames were intended to simulate the frame of the observa- 

impression that old frames were simply being 
stored in the old bookcase ^ 

in th^ *ke camera audio system, was concealed 

‘>’‘= 

coaxi J rnhlp “penmenter and subject sat The 

made to ann the microphone to the camera equipment was 

™ acco 3 Xu f™-" '>■= to » wtill socket This 

true cable em u ih “""“hng a false cable between the point where the 

In order ,0 0 ;™"=“ “-tby wall socket 

m the camera u u System ot Communication between investigators 

menters TwTa ” “ , a = of subjects and elpen- 

located in th telephones were used One telephone was 

located m the camera room and was positioned m such a way that the 

•Thairrinle "" sentence was inserted here 

crfure ’ experimenter follows h.s mstrucuons and proper experimental pro 
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tell” they were blind 


TABLE 15-8 


Observations of Experimenter Behavior and Magni- 
tude of Expectancy Effect 


Behavior 

Expectancy 

Effect 

Dominant 

Lifting 

Activity 

Professional 

Dominant 

Likable 

Activity 

Professional 

Friendly 

+ 53** 

+ 54** 

- 48* 

+ 63*** 

- 03 

+ 38 
-44* 

+ 38 
+ 12 

+ 12 
+ 36 
+ 60*** 

_ 65*** 
+ 59*** 

- 19 


* p< 10 

** p < 05 

*** p ^ 


Table 15-8 shows the correlation between to 
ratings and magnitude of , deeree of expectancy effects may 

among the ratings In this tnrtough\he subjects’ 

safely be regarded as the depend observations of to expenmenters 
responses could be observed, si contacted — i e , no ex- 

were all made while practice su j expenmenters 

pectancies had as yet been '" “ subsequently by those 

Greater expectancy effects w more in charge of the 

menters who were judged as m P ,,,2 observers The 

situaUon, less hyperactive, an w several of these four vana 

intercorrelauons among the ^ experimenters were seen as less 

bles tend to cluster together Hyp „_o„mental situation These three 
professional and less in charge o P j s^tus dimension discussed 

Liables seem to constitute to professiona 
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Most of the 91 interactions were filmed in their entirety, but some- 
times the film ran out before the experimenter could fimsh obtaimng the 
photo ratings from the last subject scheduled to be filmed Sometimes, too, 
an experimenter was very slow, or a subject was, so that to film the entire 
interaction would have meant losmg the subsequent interaction with a sub 
ject of the opposite expectancy Since one of the mam reasons for this film- 
ing was to learn what experimenters did differently in their interaction with 
subjects from whom they expected different ratings, very lengthy interac- 
tions were interrupted Sometimes, for example, an expenmenter would 
make small talk before or after recording the “face sheet” data from the 
subject Such small talk was sometimes not filmed When subjects were 
very slow m making their ratings, the rating penod was sometimes inter- 
rupted There was good reason to beheve that the communication of the 
expenmenter’s expectancy occurred before the subject made his first re- 
sponse, the evidence for this to come in the next chapter Therefore, inter- 
rupting the rating penod was felt to be particularly preferable to losing the 
preratmg penod with another subject 


A Preliminary Analysis 

There were 15 expenmenters for whom films were available of their 
interaction with subjects for whom they had been given no expectancy 
Expenmenters’ behavior in interaction with these subjects, therefore, re- 
flected their “typical” behavior in the expenment uncomplicated by the 
addition of any formal, uniform expenmental hypothesis To be sure, each 
experimenter may have entertained hypotheses about the responses to be 
obtained from each of these “practice” subjects, but these idiosyncratic 
expectancies were probably fairly randomly distributed among the ex- 
perimenters 

The five investigators served as the first observers and independently 
rated each expenmenter contact on the foUowmg vanables 

1 Dominance the extent to which the expenmenter was clearly m 
charge of the situation 

2 Liking the extent to which the observer liked the expenmenter 

ctivity the extent to which the expenmenter manifested gross and 
nonessential movements 

^ the extent to which the expenmenter showed profes- 

sional good form” m his role as experimenter 

5 Friendly the extent to which the expenmenter was fnendly to his 
subjects 

For each vanable, ratings could range from 1 (least possible) to 10 
(most possible) No effort was made to be more precise m either the defini- 
tions of the vanables or the rating scale At most, these observations of 
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stage was that during which the expenmenter 

nhotos to his subjects and recorded their response for each Very roughly, 
Cst or pr in tructional phase lasted only about halt a minute, the in- 
*ru^ion reLing lasted only about a minute, and the rating penod about a 
“ aura hiu Table 15-9 shows the mean time in seconds required 


TABLE 15-9 


Mean Duration of Three Stages of Experimental 
Interactions 


Mean duration 
Standard 
deviotion 
Number of 
interactions 


STAGES 


instructional 

Instructional 

Rating 

Total 

36 4 

bll 

94 6 

196 1 

88 

10 8 

34 3 

42 3 

80 

85 

65 

65 


The standard deviations are also given as 

“Kiss oi'Si. “P“ ”” 

standard deviation are based 


More Molecular Variables 

careful analysis of the appearanc clothing he wore, 

Fnedman oteervcd for each often he exchanged 

how often he smiled and glanced a 1 mstrucUons to the 

glances with the subject, how J action lasted Katz observed 

Subject, and how long each Ph;>- ‘'■^.^"rtoction of gaze, head and 
tor each expenmenter his smiling, g A g^t, and the manner of hold- 
body activity, body position re a ive For most of the vanables, 

mg the stimulus photo during t e ra three stages of the expen- 

observations were made not only he stages Therefore, the 

ment but at many specific points wito each 

total number of observational vanables ,he first 

separate analyses were made by o foe ,I,e last 

two samples of experimenters oombmed CA. an 
three samples of experimenters combined (B3, 
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earlier (mean mtercorrelation = 50) Observers’ liking of experimenters 

shows a lower mean correlation with the professional status variables 
(^29) and may be related to the interpersonal style dimension discussed 
earber Somewhat inconsistent was the finding that the variable of fnend- 
bness to subjects, which was correlated significantly with the liking variable, 
showed no relationship to magnitude of expectancy effects Fnendliness was 
significantly positively associated for this sample with hyperactivity and 
negatively, but not significantly, with professionalness It may be that 
fnendliness as judged by the observers was a hyperfnendliness which inter- 
fered with the professional business of the interaction Some support for the 
finding, though not necessanly for its interpretation, comes from the recent 
report by Silverman (1965) that subjects are less responsive to the demands 
of a possibly too-fnendly expenmenter 

The possibility that the data presented here might be contaminated by 
the observers’ exposure to criterion information was raised earlier Some 
evidence is available, however, which suggests that these observers’ ratings 
may yet have a measure of validity Subsequent blind observations of the 
films were earned out by Neil Friedman (1964) and Richard Katz (1964) 
Some of these observations served to anchor our cruder observations to 


more precise, uncontammated ones Thus, the more “dominant” of this 
sample of 15 experimenters observed when contacting subjects in the “no 
expectancy” condition were found to be significantly older and therefore 
higher status (Vikan-Kline, 1962) (rrz-p 54), less likely to show gross 
body activity (r = — 57), and more expeditious m instructing their sub- 
jects (r = + 40) More “professional” expenmenters were found to make 
sigmficantly fewer errors in reading their instructions to their subjects 
More “active” experimenters were found to show more gross 
0 y activity (r = -f- 63) Better liked experimenters looked (r “ + 64) 
^ smi ed (r ^^ 4- 51) more at their subjects throughout the experiment 
ina y, more fnendly expenmenters smiled more at their subjects dunng 
the entire experiment (r = -{-87) The nature and magnitude of these 
corre a ions suggests that the more global and possibly contaminated ob- 
serya ions mig t, after all, be reasonably valid, especially m view of the fact 
correlations with the “anchoring” variables reported 
vanab'lesTr -'*V3^4^*"^'''*' mterobserver reliability of the more global 

i-n . subsequent analyses of the filmed sessions, observers were 

IieFn expectancy the filmed expenmenter 

held for the responses of any of his subjects All observations made of the 
films subsequently were made separately for the three stages of the expen- 
mental interactions The first or preinstnictional phase required the expen- 
menter to obtain and record the subject's name, age, sex, marital status, 
year in school, and major field of study The second stage required the 
expenmenter to read the standard instructions to his subject The third 
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were tenable after further analj-ses (Rosenthal. Friedman, & Kurland. 

^^^^Liong female experimenters of these same experimental 
„one of Jbehaviors during the P^mpared fo 

nificantly the subsequent “ ^ Ijo^-ever, in 

male experimenters there a si^ subsequent expectancy 

the correlations between their e aw glances vfith their sub- 

Itw^d^elt^r^exStancy effects on di.ir -bj-’ -bse^- 

(There was no Although the sample of female 

tions and subsequent expectancy this reversal, it may be rea- 

experimenters was too small to make much of ig.et- 

sonable to expect that female ^ gaily oriented. That would 

personal influence when they are & Bales, 1955) 

be consistent mth those theoreO ,wgn.]]and 1965) that suggest that 
and those summaries of relevant stress on t^k orien- 

men function more typicaUy and effecU > y ^ effectively by a 

ration relative to women, who f“”=bo“ ‘Average” subjects in “aver- 
greater stress on socioemouonal -soond to the subtle cues of ex- 

age” experiments may be better a joeiaiiy expected role behaviors, 
perimenters who are playing ou overshadowed and obscured by 

These subtle biasing cues may ^ lor all of the subjects 

any behavior that, by its unexpectedness, cans 

attention. 


More Molar Variables 

For the most part, the 

perfect (1.00) reliabilities “'J" ^,hese data is far from complete 

glancing at subjects). The analysis ^ ^ gtjUty of these more 

Ld thfy have Veady sho^ ‘beir 'ntiue.^.qga’nl expectancy effects was 
molecular variables as predictoR relatively few correlaUons fta 

somewhat disappointing m we computed. It seemed likely that 

reached significance out of the ““^s comp^^^^^^^ of expen- 

ihe more molecular variables were communicauon value 

menters’ behavior which might b^ communication, but rather 

A glance is not just a glance, interested glance, an encourap g 

a friendly glance, a dominating g ’ j gbout the exact f^^^ires 
glance. Too little is known at ‘b= one glance or one smile 

heial expression or a body movement that 
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From the analyses completed so far of these data (Fnedman, 1964, 
Fnedman, Kurland, & Rosenthal, 1965, Katz, 1964, Rosenthal, Fned 
man, & Kurland, 1965), it appeared that the behavior of the expenmenter 
during the instructional period was the best predictor of the magnitude of 
his subsequent expectancy effects The degree to which each subject was 
influenced by his experimenter’s expectancy was defined as follows When 
the experimenter’s expectancy was for a -f-S response, the subject’s magni- 
tude of influenceabihty was his mean rating of the photos minus the grand 
mean photo rating of all subjects (not only those who had been filmed) for 
whom that expenmenter had an expectancy for a —5 response When the 
expenmenter had an expectancy for a —5 response, the subject’s “bias” 
score was his mean photo rating subtracted from the grand mean photo 
rating of all subjects for whom that expenmenter had an expectancy for a 
-f 5 response 

For just those expenmenters of conditions Bg, B4, and B5, all of whom 
were males, all of whom had no pnor research experience, and all of whom 
contacted either male or female subjects but never both, only a single cluster 
of behaviors, all of them during the instruction period, predicted subsequent 
expectancy effects Expenmenters showed greater subsequent expectancy 
effects if they exchanged fewer glances with their subject (r = — 41, 
p = 02), read their instructions with fewer errors (r = — 42, p = 02), 
and required less time to read the standard instructions, particularly the first 
short paragraph (r = _ 43, p — 02) The mean intercorrelation of this 
cluster of vanables was -f- 37 This more businesslike, no-nonsense experi- 
menter IS just the kind we would expect, on the basis of all the earlier evi- 
dence, to be the more effective unintentional influencer (Friedman, Kurland, 
& Rosenthal, 1965) 


The male and female experimenters of conditions Ai and A2 had all 
a pnor research experience, and all contacted both male and female 
su jects Correlations between these expenmenters’ behavior and their 
su sequent expectancy effects were computed separately for male and fe- 
male expenmenters Among male expenmenters, those who exchanged 
fewer glances with their subjects (r = — 59, p = 02) and required less 
time to read the instructions (r=: - 52. p < 05) subsequently showed 
greater expectancy effects These findings and the fact that the more unin- 
n lona y in uential expenmenters showed less gross body activity (r = 
p < ) support still further the hypothesis that more professional 

c ^nmcnlcre show greater expectancy ellects In this replication, how- 
escr, there was an unexpected reversal of the relationship between the 
accuracy of instruction reading and subsequent expectancy effects Now it 
was the expenmenters who made more errors in reading their instructions 
who subsequently showed greater expectancy effects (r = + 65. p < 01 ) 
."u j hypotheses were suggested to account for this reversal in terms 
of the different characteristics of the samples of experimenters, but none 
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TABLE 15-10 


Some Median Interobserver Reliabilities Under Three 
Conditions of Observation of Instructional Behavior 


COMMUNICATION CHANNELS 


Reliability 

Lowest 

Median 

Highest 


Visual plus Auditory 
(30 Variables) 

- 12 
+ 28 
+ 50 


Visual Only 
(24 Variables) 

- 26 
+ 27 
+ 55 


Auditory Only 
(23 Variables) 

- 10 
+ 12 
+ 32 


three conditions of observation Table 15-10 ^ 

rehabihty coefficients (r) of the sets f eo^^^^^ 
observauon For the 30 observations made with access to both 

tion channels, the highest median re la i y Because some of 

the median of the 30 observa- 

the observations were impossible und track') the numbers of 

uon (e g . loudness of voice in the absence Table 15-10 

reliability coefficients possible f®'’ “f ^ negative rehabiUties The 

In all conditions of ‘ depressing, and thf maximum rehabiUties 

median rehabiUties were similarly p coefficients 

were reminiscent more of “fl^dings the means of the observers’ 

In spite of these unencouragmg ^ experimenters 

judgments within each condition were Of the 77 cor- 

subsequent expectancy effects The resul ^ 29) 

relations, 17 (or 22 percent) ^jnnts from experimenter behavior 

The correlations predicting J ^„on of obsemtion Table 15-11 

were clustered separately within e , j,e five clusters obtained Every 

shows the vanables constituting eac o pcant correlation with ex- 

vanable included in any cluster ns is shown in Table 

pectancy effect (p < 10). ^n eac clusters its mean correlation 

15-11 Table 15-12 shows for cluster expressed by 

with every other cluster, ‘*1® variables with each other, and the 

the mean mtercorrelation of th , „ngs with the magnitude of 

mean correlation of the cluster of behaviora 

subsequent expectancy effects (I) might be labeled as the 

The most significantly predicUv ved by paradigm observers 

behavior of the hkable-professional as P ^Tie hkable-professiona 

judging only his visually , visual impression, and was casua 

was relaxed (not tense), gave a snbiects This constellation of bc- 

(“not pushy”) in his approach to his suuj 
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difiEerent from another glance or another smile But ordinary people m 
everyday life seem able to make these judgments 

It was, therefore, decided to employ a sample of undergraduate stu- 
dents as paradigm observers As members of the culture, they should be 
able to make the required judgments, not perfectly, but well enough The 
particular judgments they were asked to make were the same global 
judgments that subjects had been making for some years about their ex- 
perimenter’s behavior These judgments, made on 20-point rating scales, 
had proven to be useful, and in any case, it would be good to know whether 
external observers of an expenmenter’s behavior could predict his ex- 
pectancy effect as well as subjects could postdict it The basic variables were 
those presented m the chapter dealing with the effects of excessive reward 
Four additional variables were employed “active,” “dominant,” “impor- 
tant-actmg,” and “speaks distinctly ” The first two were added because they 
had been employed in the preliminary analysis of the films and had been 
found promising The third was added because it had been employed in 
earlier studies and seemed relevant, the last was added for these analyses 
A total of ten undergraduate students, six females and four males, 
rated each expenmenter’s behavior separately for the prcinstructional pe- 
riod, the instruction-reading period, and the period m which the subject 
made his ratings of the level of success of the stimulus person Three ob- 
servers (one male, two females) made their ratings while watching the film 
and heanng the sound track Four observers (one male, three females) 
made their ratings while watching the film but without heanng the sound 
track Three observers (two males, one female) did not see the film at all 
but made their ratings solely from listening to the sound track 

The reason for the last two groups of observers was the thought that 
the meamng of a gesture or a tone might be thrown into bolder relief if it 
wre not cross-referenced by another channel of communication Single 
c annel (le, visual or auditory) judgments could also be examined for 
discrepancy, and “channel discrepancy” has long been thought to be an 
mportant factor m normal and abnormal human communication (Allport & 
ernon, 33), though the evidence for this assumption has been at the 
anecdotal level (Bateson, Jackson, Haley. & Weakland, 1956, Ringuette & 
Kennedy, 1964) > > o 

Of the 29 experimenters whose interactions with their subjects had 
been filnied, only 19 (16 males and 3 females) were filmed m interaction 
both with subjects from whom they expected -f 5 ratings and with subjects 
from whom they expected —5 raUngs These 19 experimenters were ob- 
served m sessions with 48 subjects (33 females, 15 males) for whom they 
had one of these two opposite expectancies We shall consider first the 
behavior of the experimenter during just the instruction-reading penod as a 
predictor of his subsequent expectancy effects 

The first look was at the interobserver reliability within each of the 
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nverall imDression of the competent, professional experimenter as the one 

•"“S' ™ 

such a too-friendly tone may intertere wi activity” cluster, and 

erted by the experimenter Cluster V w . j expectancy effect 

behaviorally tense, as professional and competent. 

Such expenmenters could hardly be P e^oenmenter, subjects 

and weLve seen that The cor- 

are unhkely to be influenced by t eir “lijcable-professional” 

relahon between tlus ne^ous activi y cl^^ professional 

cluster was not high (r _ - 29), „ a, so unable to influence 

and yet nervous Such experiment p y hyperactivity would 

their subjects’ responses ‘f ! J j „ of the uranWnded message by 

probably interfere with the subject s "g of 

providing a context of excessive ^ ,he behavior of expen- 

One of the reasons for having uias to learn about 

menters using only a single channe o vanables on which 

the effects of channel discrepancy judgments were available 

behavior was judged there were 17 f “ ^,J^/„orvous, for example, 
from both groups of single-channel judg R ning 13 vanables 

could be judged from sdent films or sound . 

could be judged from only one of the two sing 

servation (e g , expressive voice or leg alone and 

For eal of the 17 - ju^^^ was computed s^ply 

from auditory cues alone, a channel disp^^ expenmenter in the auditory 

by subtracting the mean rating g a^cnmenter in the visual chan- 
channel from the mean rating assig „f,nbie simply means that the ex- 
nel A large discrepancy score on any ^l^an m the auditory 

perimenter is rated higher on that v , jy possible correlations be- 
modahty Table 15-13 ‘hose 7 ot^^^ uiagmtude of subsequent ex- 
tween magnitude of channel dis p ^ . jj of these vanables were 

pectancy effects that reached a p ^ mtcrcorrclation o 

highly intercorrelated, forming a i.jrable-professional cluster reporte 

+ 52 This cluster is very similar to . Usdf rather than in rela- 

earher when the visual channel was cflectire unintcntioml 

non to the auditory fPP"'"^,^„sional but must, in addition not 

influeneer must “look" like a hhable-proless 

sound like one, perhaps because a too lika „u„,a„on of the mteraeting 
the instructions would detract from the 
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TABLE 15-n 


Clusters of Experimenter Instructional Behaviors Pre- 
dicting Subsequent Expectancy Effects 


OBSERVATION CHANNEL 


Visual 


Auditory 


Visual plus Auditory 

Cluster / 


Cluster IV 


Cluster V 

-44 

Relaxed 

+ 56 

Pleasant 

- 33 

Leg gestures 

Likable 

+ 46 

Honest 

- 30 

Hand gestures 

- 37 

Professional 

+ 45 

Expressive voice 

- 30 

Arm gestures 

- 34 

Honest 

+ 40 

Active 

- 25 

Body gestures 

- 32 

Casual 

+ 29 

Friendly 

- 25 

Trunk gestures 

- 31 

Cluster II 
Dominant 

+ 32 

Personal 

Not acting 

- 25 

Head gestures 
Nervous 

- 30 
-30 



importont 




Cluster III 
Businesslike 
Arm gestures 

+ 33 





not used 

+ 25 






haviors is just the one we would expect on the basis of ( 1 ) our possibly con- 
taminated preliminary analysis, (2) the data available from subjects’ 
perceptions of their experimenter, and (3) the more expenmental evidence 
available from this research program and those of others 

Clusters 11 and III, based also on the visual channel, strengthen our 


TABLE 15-12 


Intercorrelations Among Clusters of Experimenter In- 
structional Behavior 








Meon r 

Clusters 





Mean r 

Expectancy 

1/ 

Ill 

IV 

V 

Intracluster 

Effects 

1 

+ 13 

+ 19 

00 

-29 

+ 65 

+ 43 

II 

— 

+ 03 

+ 12 

+ 04 

+1 00 

+ 32 

111 


— 

- 10 

-46 

+ 51 

+ 29 

IV 



— 

+ 07 

+ 59 

- 28 

V 




-- 

+ 51 

- 34 
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experimenter shows a given behavior more in the visual than in the auditory 
channel were computed. For this analysis interactions with 57 subjects were 
avmlable, and there were 17 possible correlations. Table 15-14 shows the 
five correlations with p :< .10. All five of these variables were highly inter- 
correlated, forming a cluster with a mean intcrcorrelation of 4-.63. These 
experimenters showed greater “dominant-enthusiasm” in the visual than in 
the auditory mode when interacting with male subjects- When interacting 
with female subjects, they showed their enthusiastic-dominance relatively 
more in the auditory than in the visual channel. One wonders whether such 
a relationship may have relevance not only for a better understanding of 
the social psychology of the psychological experiment but also for a better 
understanding of interpersonal communication in general. 

At least we know that the results obtained and just reported are not a 
unique function of the instruction-reading situation in a psychological ex- 
periment. Channel discrepancies of behavior in the half minute of the pre- 
instructional period were also computed. This was that brief and more 
informal period during which the experimenter asked for and recorded the 
subject’s name, age, and other such data. Channel discrepancies were again 
correlated with the sex of the subject. For this analysis 50 subjects were 
available, and again there were 17 possible correlations. Table 15-15 shows 
the seven correlations with p ^ .10. Again these variables were highly inter- 
correlated, and the cluster’s mean intercorrelation was -f-.45. Although this 
cluster of behaviors was not the same as that found during the instruction 
reading period, it is similar enough that it may be regarded also as a 
“dominant-enthusiasm” cluster. Even during this brief period experimenters 
showed greater enthusiastic-dominance ia the visual than in the auditory 

TABLE 15-15 


Visual Minus Auditory Channel Discrepancies in Ex- 
perimenter Premstrucfional Behavior and Sex of 
Subject 


Behavior 


r P 


Dominant 

Active 

Relaxed 

Enthusiastic 

Interested 

Businesslike 

Friendly 


+.36 

.02 

+.34 

.03 

+.31 

.03 

+.30 

.04 

+.27 

.06 

+.26 

.07 

+.24 

.10 


Mean 


+.30 .04 
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TABLE 15-13 


Visual Minus Auditory Channel Discrepancies in Ex- 
perimenter Instructional Behavior and Subsequent 
Expectancy Effects 


Behavior 

r 

P 

Likable 

+ 44 

003 

Relaxed 

+ 44 

.003 

Pleasant 

+.42 

.005 

Honest 

+.41 

.007 

Professional 

+.33 

.03 

Casual 

+ 28 

.07 

Friendly 

+.26 

.08 

Wean 

+ 37 

.01 


dyad The subject is watching the experimenter, usually, while the instruc- 
tions are being read, but the subject’s mam task is to hear and understand 
these instructions 

These channel discrepancies in behavior may have a very different 
meaning depending on the sex of the experimenter and the sex of the subject 
(Rosenthal, 1965c) Future work will be done in this area, but for now it 
may be interesting to see the effects of the subject’s sex m the channel dis- 
crepancies of these pnmanly male experimenters The point biserial cor- 
relations between the sex of the subject and the degree to which the 

TABLE 15-14 


Visual Minus Auditory Channel Discrepancies in Ex- 
perimenter Instructional Behavior and Sex of Subject 


Behovior 

Dominant 

Enthusiastic 

Interested 

Personal 

Professional 

Weon 


r 

P 

+ 53 

0001 

+ 35 

01 

+ 26 

06 

+ 25 

07 

+ 22 

10 

+ 32 

02 
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manner, the greater the disagreement between channels, the greater the 
subsequent expectancy effects Perhaps such channel discordance so con- 
fuses the subject, perhaps even without his awareness, that he toes espe- 
cially hard to “read” the unintended messages from the expenmenter so 
that he may better learn what really is expected of him The particular 
variables shown in Table 15-16 were well clustered, with a mean mter- 
correlation of -|- 53 

When we turn to the mstnichonal penod for an examination of the 
absolute channel discordance as a predictor of expectancy effects we again 
find three significant predictors Table 15-17 shows them, and we note 


TABLE 15-17 


Absolute Channel Discordance in Instructional Be- 
havior and Subsequent Expectancy Effects 


Behavior 

r 

P 

ReJoxed 

-37 

0) 

Enthusiastic 

- 36 

.02 

Honest 

+ .26 

08 


that two of them, “relaxed” and ‘ honest,” were also significant predictors 
when their algebraic channel discrepancies were considered The correla- 
tion between the algebraic and absolute discrepancy for the vanable “hon- 
est” was 65, so perhaps this variable does not mean anything different 
from what we have seen before However, the correlation between algebraic 
and absolute channel discrepancy for the vanable ‘ relaxed ’ was only — 07, 
so in this case we do have a different vanable During the instruction penod 
expenmenters who show less discordance of the visual and verbal channels 
m their tension level and in their enthusiasm level go on to exert greater 
expectancy effects (The correlation between these vanables was only 
-}- 18 ) Perhaps dunng the instruction penod, too much channel discord- 
ance, of a less systematic sort than is implied in algebraic discrepancy, 
confuses the subject at the veiy moment he is to receive the expenmenters 
unintended cues to what the “nght ’ answer might be Unsjsteraatic channel 
discordance may be a good way to get a subject to be attentive, but when 
It serves as bacLground to unintended specific communications it may 
serve as just so much noise 

Although we have discussed the question of chinnci discrepancies in 
the prcinstructional behavior of the expenmenter, vve have not jet con- 
sidered the prcinstructional behaviors in each of the three conditions of ob- 
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mode when contacting male subjects, whereas with female subjects they 
showed relatively greater enthusiastic-dominance in the auditory channel 
When channel discrepancy m the preinstructional period was employed 
as a predictor of subsequent expectancy effects, the results were less im- 
pressive than when channel discrepancy in the instruction-reading period 
had been employed Still, the results were consistent, if less sinking Ex- 
perimenters who showed greater interest in the visual than in the auditory 
mode exerted greater subsequent expectancy effects (r = -f- 30, p = 06) 
Expenmenters who showed a more businesslike manner in the auditory 
than in the visual channel showed greater expectancy effects (r = — 30, 
p = 06) Although these correlations were not very significant statistically, 
they suggest an early form of the pattern which emerges more clearly m the 
instructional period (The correlation between these variables was +1^* 
which makes the multiple correlation -|- 45, p = 02 ) 

When speaking of “channel discrepancy” the “discrepancy” has always 
been taken by subtracting the mean rating of an expenmenter’s behavior 
ju ged only from the sound track from the mean rating of his behavior 
]u ged only from the silent film Therefore, channel discrepancy has been a 
rectional discrepancy In clinical lore the importance of communication 
Channels carrying opposite messages does not depend on a given direction 
0 1 erence It seemed interesting to see whether disregarding the direction 
discrepancy would teach us something about the unintentional 
uence 0 an experimenter’s expectancy We turn now to the correlation 
J absolute discrepancy between the visual and auditory channels, 
^ Pot! isregarded, and the magnitude of expectancy effects 

tioml e'tpenmenter’s behavior during the brief preinstruc- 

bchaviLol VI 15-16, that channel discordance in three 

ouent ss (out of a possible 17) significantly predicted subse- 

auditorv^conv'"^^n*^ n'** Regardless of which modality, the visual or the 
auditory, conveyed the greater interest, enthusiasm, or professionalness of 


TABLE 15-16 


W and'’rh'' - Preins, ructionol Be- 

havior and Subsequent ExpeConcy Effects 


Sehovior 

Interested 

Enthusiastic 

Professional 

Meon 


r 

P 

+ 46 

.005 

+ 41 

01 

+,35 

03 

+.41 

.01 



Behavioral Variables 


279 


TABLE 15-79 


Clusters of Experimenter Preinstructional Behaviors 
Predicting Subsequent Expectancy Effects 


OBSERVATiON CHANNEL 


Visual 


Visual Plus Auditory 

Cluster 1 
Likable 

+.39 

Cluster IV 
Relaxed 

+.42 

Relaxed 

+.34 

Dominant 

+.31 

Personal 

+.30 

Active 

+.29 

Enthusiastic 

C/uster fl 

+.24 

Cluster V 

Leg gestures 

-.31 

Honest 

-.25 

Trunk gestures 

-.25 

Cluster III 

Not octing 
important 

-.37 




fectively inSuential experimenter is less formal during this less formal stage 
of the experiment than he will later become. In the visual-plus-auditory 
mode the more unintentionally influential experimenter again showed his 
lack of tension as well as showing that he was very much in charge of the 
situation. 

The overall impression we have of the behavior of the experimenter 

TABLE 15-20 


Intercorrelations Among Ousters of Experimenter 
Preinstructional Behavior 


C/usfers 

II 

III 

/V 

1 

-.06 

-.76 

+.25 

n 

_ 

+.36 

.00 

III 


- 

-.30 

IV 



- 


V 



Weon r 

Meort r 
Expectancy 

V 

Intracluster 

Effects 

.00 

+ .54 

+ .32 

+.21 

1.00 

-.25 

+.34 

1.00 

-.37 

-.17 

+ .46 

+ .34 

_ 

+ .42 

-.28 
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TABLE 15-18 


Some Median Interobserver Reliabilities Under Three 
Conditions of Observation of Preinstructional Be- 
havior 


COmUNICATION CHANNELS 

Visual plus Auditory Visual Only Auditory Only 
Reliability (30 Variables) (24 Variables) (23 Variables) 


Lowest 

Median 

Highest 


- 16 
+ 16 
+ 39 


-.12 

+.20 

+.41 


-.23 
+.08 
+ 45 


servation that predict subsequent expectancy effects Table 15-18 shows the 
highest, midmost, and lowest median reliability coefficient (r) of the sets 
of observers within each condition of observation As in the case of the 
interobserver reliabilities of the rating of instructional behavior, the cor- 
relations are so low that one wonders how such variables can be predictive 
0 anyt mg It should be kept m mind that the mean of the observers’ rat- 
ings IS a much more stable estimate of the experimenter’s behavior than is 
single observer Individual observer idiosyncrasies are 
pro a y canceled out in taking the mean observation as the definition of 
the experimenter s behavior 

pfcinstructional period none of the behavior observations made 
predictive of subsequent expectancy effects 
chinnpi* ti, *i Visual channel and for the visual-plus-auditory 

All the v^n^hl behaviors predicting subsequent expectancy effects 

shows the IS given for each vanable Table 15-20 

emeraed the Jmong the five predictive clusters which 

unity) and the ” ^rcorrelation of the vanables forming a cluster (cluster 
quent exnec ancr n behaviors with subse- 

«penmentcrshoweffivUfns?e°tswed’^’’^^ H'h 

the cxnenmentp,.’ . prcdicting expectancy effects, just as did 

saL roHcre he^ **"**“"‘°^- Asters were no! quite the 

between Tables IS-^o'andTs-lf)^ ™f>=‘b'es (The comparison is 

mcnter’s**nre!nsi'ni"t°'*°’i'^'i,"'f°'^"* *"* '"^■™'=»onal behavior, the expen- 

cfmrunnni . i . ° honcst. Or scrupulous The prein- 

structional period was less clearly dcfinpH fnr ^ . .u „ fisp 

instmct.on-read.ng period, and the eenerlfl 'han the 

t' , uuu me general impression is that the more cf- 
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There is now a good deal of evidence bearing on the question of what 
structural and behavioral characteristics of the experimenter tend to in- 
crease the operation of expectancy effects. But perhaps the most important 
question of all remains to be answered. That question, of course, is how 
does the experimenter inform his subject what it is he expects the subject 
to do? Data from several studies including the leisurely analysis of films sug- 
gests that no gross errors are responsible. Experimenters do not tell their 
subjects in words or even in any obvious gestures what it is they expect 
from them. Errors of observation and of recording, although they do occur, 
occur so rardy as to be tcmai to any explanation of experimenter ex- 
pectancy effects. 


INTENTIONAL COMMUNICATION OF EXPECTANCIES 

If experimenters were asked to communicate their expectancy to their 
subjects we might hope that the cues they employ intentionally might be 
simple exaggerations of cues employed unintentionally in the real experi- 
mental situation. As a first step, however, it would necessary to leam 
whether observers could accurately “read" the expectancy intentionally 
being communicated by the experimenter. 

Six graduate students and one faculty member of our research group 
served as the subjects of the first study. One of the graduate students ad- 
ministered the photo-rating task to the remaining subjects. The experimenter 
chose a number between —10 and -f 10 as the expectancy he would try to 
communicate to the subjects. The subjects’ task was to try to “read" the 
experimenter’s expectancy. Table 16-1 shows the results of two such at- 
tempts to read an intentionally communicated expectancy. Observers’ ac- 

281 
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who shows greater expectancy effects is that he is professional, competent, 
hkable, and relaxed, particularly m his movement patterns, while avoiding 
an overly personal tone of voice that might interfere with the business at 
hand When his interactions with the subject are not highly programmed by 
the design of the expenment, he relaxes his professional demeanor a bit, 
and perhaps engages his subject’s attention more by showing discrepancies 
between his movement patterns and his tone of voice When his interactions 
with the subject are more formally programmed, he becomes more formal 
in manner and sends more congruent messages through his movement pat- 
terns and his tone of voice 

The behavioral variables considered in this chapter, and the more 
structural vanables considered m the last chapter, which are predictive of 
experimenter expectancy effects, may not be so different from the vanables 
that predict other forms of interpersonal influence Perhaps unintended so- 
cial influence processes are governed by the same pnnciples that govern 
intentional interpersonal influence The major differences between inten 
tional and unintentional influence processes may turn out to be associated 
with the system of communication or signal transmission employed When 
the influence is intentional, as m studies of compliance, persuasive com- 
munication, or verbal conditioning, the signals of the influencer are both 
highly programmed and overt When the influence is unintentional, the sig 
na s of the influencer are less overt and probably occur in a context of 
peater noise In the next chapter we shall discuss the problem of signal 
transmission in the experimental situation 
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bers, one was a representative of a publishing firm who happened by, and 
the rest were graduate students from a midwestem and an eastern university. 

The second film was of five experimenter-subject interactions. Ex- 
pectancies were again assigned at random. This film was viewed by 11 ob- 
servers. One observer was a faculty member, one a wife of a faculty 
member, and the rest were graduate students. Three of these had served as 
observers of the first film; otherwise there was no overlap of observers for 
the two films. 

Table 16-2 shows for each film the experimenter’s randomly assigned 

TABLE 16-2 


Observers' "Readings" of Experimenters' Randomly 
Assigned Expectancies 


EXPECTANCIES 

Eypenmenters* Guessed (Mean) 

Film I -10.0 -4.6 

-1.0 +1.3 

+2.0 +2.S 

Film II +7.0 +6.1 

+5.0 -1.S 

+3.0 -0.4 

-9.0 -5.3 

-9.0 -2.2 


expectancy and the mean “reading” of that expectancy by the observers. 
For each film, a correlation (rho) was obtained between each observer’s 
“reading” of the experimenters’ expectancies and the actual expectancies. 
The median of the 52 correlations thus obtained for film I was -1-.88 
(p < .00001). The median of the 11 correlations obtained for film II was 
-f.72 (p<.001). These results leave little doubt that observers can 
“read” experimenters’ expectancies with great accuracy, at least when these 
are being deliberately communicated. 

It might be expected that when observers can agree so well on experi- 
menters’ expectancies they would agree on the channel by which these 
expectancies were communicated. This was not at all the case, however. 
The numerous hypotheses advanced by the observers showed little agree- 
ment among themselves. Two major dimensions emerged, however, along 
which differences in hypotheses could be ordered: temporality and sense 
modality. Thus about half the hypotheses emphasized the experimenters’ re- 
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TABLE 16—1 


Subjects' “Readings" of Experimenter Expectancies 


EXPERIUENTER'S EXPECTANCY 


-4.0 

+3.5 

+7.0 

+5 5 

-2 0 

+4.5 

-2 0 

+4 0 

-2.0 

+4 0 

-3 0 

+3 5 

-3 0 

+3.0 

-0 83 

+4.08 


Means 

curacy was significantly better than chance (p = 007, one-tail) Only 1 
of the 12 judgments was senously in error 

The observers were unable to verbalize the source of the cues they had 
employed in making what were regarded as uncanny judgments The pos- 
sibihty of extrasensory perception was somewhat hghtly raised, and this 
possibility was tested A standard deck of Rhine ESP cards was employed, 
but in the short runs employed no evidence for ESP emerged No extended 
senes of tuns was required, since the ESP effect would have to emerge as 
signi cant y as our reading" of exjienmenter cues if it were to serve as an 
r? “’“hot of these “readings ’’ Subsequent conversation with J B Rhine 
n j ’ that he did not feel that ESP was a strong enough 

r prc icta c enough phenomenon to account for the communication of 
cxpenmenters expectancies to their subjects 

hvr,aii,»! l“st dcscnbed was not, of course, a fair test of our general 
e^rnnc M o^ponmenter who was free to choose 

sare iherefn ^ Ought Well have been biased in some way It became neces- 
ancies ai nnT* more exjienmenters and to assign their expect- 

Communicnt “ dition, in order to permit more leisurely study of the 

3esSr “P=no'=n^ers- behavior 

IhipelmLllTblveeri^rand+'loV*’’'^ 

j lu ana +10 were randomly assigned to expen- 

H I, ‘ u "" "> ‘he standard photos in 

l^he desired « ay but without being too obvious about it This film was viewed 
by 5. observers who tned to read the experimenters’ expectancy and stale 
their reason for their judgment Three of the observers were faculty mem- 
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Sprfc fc ““7 

m who expected obwLrs o^ teporlod greater Icreking at 

pected negative ratings These ob jaUngs and greater eye 

subjects by experimenters ^ tive raUng^s Table 16-4 gives 

avoidance by experimenters p , „ j expectancy communica- 

:”rShitro,“.Trre“— ^ 

table 16-4 


Six Theories of Expectancy Communication 


Theories 


II 

III 

IV 

V 

VI 


dimensions of theories 


Temporality 

Alter subiect's response 
After subject's response 
Before subject's response 
Before subject's response 
Before subject's response 
Before subject's response 


Modolity 

Visual 

Auditory 

Visual 

Auditory 

Visual 

Auditory 


Specificity 

Specific cues 
Specific cues 
Specific cues 
Specific cues 
General atmosphere 
Generol atmosphere 


Additional data, beanng byT^l Weick 

of experimenter expectancies, ^ ,aeh of whom admimstered the 

(1963) He employed two «P psychology students One expen- 

photo-rating task to five other was led to expec nega- 

Lnter was led to expect "‘‘“f^’Jnducted m front of Weick’s elas 

tive ratings The entire expeninemw ^^^^ of this 

m experimental social psycholo^ obtained higher mean 

study^he expenmenter ^ oLrltings (t = 2 93,p = 01, 

ratings than did the experimenter ex^cb o„. 

one-tail) For one of ”P®" the other expenmenter, the ob 

able to offer any expected data he recorded them ve^ 

servers felt that when he ^ /unexpected responses In addition, 

rapidly but that he was slow to rec P tu “"“P Jhe 

he was observed to “really then, the cues observed when the 

data For one of these «P="f“‘®?’ t, unally were similar to those ob- 

expectancy was communicated unm y the com- 

seJved (at least by holders of Theory 

ThTLTa" re" » far which suggest that small cues rom 
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action to subjects’ responses For these observers, expectancy communication 
occurred only after subjects began responding and followed a differen- 
tial reinforcement paradigm For the other observers, expectancy com- 
mumcation occurred before the subject made even his first response Within 
each of these schools of thought or observation there were some observa- 
tions favonng a visual-kinesic mode and some favoring an auditory-para- 
hnguistic mode of communication 

Table 16-3 summarizes the specific observations of behaviors that were 

TABLE 16-3 


Differential Reinforcers of Desired and Undesired 
Responses 


REINFORCERS 


Positive 

Smiling 
Head nodding 
Looking happier 
Looking more interested 
Recording response more 
vigorously 


Negative 

Head shaking 
Raising eyebrows 
Looking surprised 
Looking disappointed 
Repeating response 
Pencil tapping 
Holding photo up longer 
Tilting photo forword 
“Throwing” photo down 


hypothesized by our “reinforcement theorists” to increase the hkehhood of 
esire responses and decrease the likelihood of undesired responses Ob- 
* agreed that no two experimenters seemed to show the same patterns 
0 erentia reinforcement In addition, it was their impression that the 
employed different patterns as a function of the sex of 

experimenters communicated their ex- 
tu before subjects began responding produced two 

types of hypotheses The first of these emphasized the manner of delivering 
instructions about the rating scale subjects were to use When experimenters 
werp'^niH ^ pomts in the region of the expected data they 

snpnV f ° greater emphasis to stammer, to speak more slowly, to 
ITn .1"’ ? errors, and to point a little longer at the 

region of the scale including the desired data The Lcond type of hypothesis 
held by these observers emphasized the general atmosphere created by ex- 
penmenters even before they came to the critical section of the mstrucUons 
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by a slack watch chmn held by both. Although no observing experimenter 
could detect any sensory cue emitted by the guide to the subject, Rubini 
was able to select the correct item significantly (100 percent) more often 
than could be accounted for by chance. Even when the watch chain was not 
employed, the subject’s performance was 50 percent better than chance 
alone. When possible auditory cues were reduced, the subject’s performance 
actually improved, but when visual cues were reduced his performance de- 
teriorated. Only when all visual and auditory cues were reduced drastically, 
however, was the subject’s performance clearly no better than chance. An 
unexpected finding was that when the guide tried consciously to help 
Rubini, the latter’s performance fell off. Apparently those cues actually 
used by this subject were not easily inferred, a finding in accord with the 
data presented earlier in this chapter. 

Other workers have also suggested the importance to the experimental 
situation of unintended cues given off by the experimenter (Edwards, 1950) . 
In Jus critique of Kalischer’s research with dogs, Johnson (1913) suggested 
that the animals could correctly anticipate the experimenter’s responses 
from his posture, muscle tonus, and respiratory changes. Johnson employed 
a control series in which the dogs could not see the experimenter. These 
controls led to the disappearance of the animals’ alleged discriminatory 
ability. 

Among fifth-grade children. Prince (1962) found that a not so subtle 
marking of the experimenter’s data sheet served as a reinforcer of verbal 
behavior. A more subtle and unintended data-recording cue was reported 
by Wilson (1952). In a task requiring the discrimination of the presence 
and absence of a light, it was found that subject performance varied as a 
function of the data-recording system. That system yielding the best "dis- 
crimination” was one in which a longer pen scratch by the experimenter 
was associated with one of the alternatives. (A fuller discussion of some of 
these cases of communication by means of small cues is available elsewhere 
[Rosenthal, 1965a].) 


EXPERIMENTAL RESTRICTION OF COMMUNICATION 

In the preceding section we saw the potential relevance for the com- 
munication of experimenter expectancies of the visual-kinesic and auditory- 
paralinguistic modalities. In this section data will be presented that were in 
part designed to show which of these two channels of communication might 
be the more important (Fode, I960; Rosenthal & Fode, 1963). 

The standard photo-rating task was administered to 103 male and 77 
female students in introductory psychology classes by 24 male advanced 
undergraduate engineers. In this study experimenters did not show each of 
the 10 photos to their subjects. Instead the endre set of photos was mounted 
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TABLE 16-5 


Weick's Classroom Demonstration of Experimenter 
Expectancy Effects 


EXPECTANCY 



+5 

-5 


+2.20 

-1 35 

Sufa/ects’ 

+0.50 

+1.10 

Weon 

+0 75 

-1.35 

Ratings 

+1.85 

-0 65 


+0 60 

-0 25 

Wean 

+1 18 

-0 50 


penmenter serve to communicate his expectancy to the subject are not 
without precedent In an earlier chapter we discussed some of these now 
classic cases There was Clever Hans (Pfungst, 1911), who could read the 
^erunenter’s expectancy from his head, eyebrow, and nostril movements 
There was the phenomenon of unintentional whispering to subjects in ESP 
research (Kennedy, 1938) A short time later Kennedy (1939) suggested 
that involuntary movements by experimenters m ESP research might pro- 
VI e su jects with kinesthetic, tactual, auditory, and visual cues to the 
expected response Much earlier, MoU (1898) had discussed Wernicke’s 
warning o the involuntary cueing by muscle tremors of subjects m experi- 
ments in clairvoyance The reading by subjects of cues in ESP research 
?i? occur Without their awareness and even at normally sub- 

threshold values of illumination (Miller, 1942) 

r 'nvestigations of the dramatic cue- 

='PP‘‘™<ly hypersensitive individuals Foster (1923) 
f “P™“'=nts designed to test the ability ot a “sensitive” 
of these stud!i-s'° hidden matenals by means of a divining rod The results 
exDenmentpr possible sources of cues from the 

able to local h dd™” removed, the subject was no longer 

Sminated Tne ? TT “d water mams Ae 

fn^shfmS:: auditory-para- 

on a famon!*" '^P^^d an extensive series of expenments conducted 
Lw™ ""■^'^ ^^''‘der.-Eugende Rubin. Bo.hE Tolman and W 
few, . of n"”.? The subject's task was to 

roolae. hL m ‘‘ '>y of ‘he expenmenters 

Contact between this expenmenter (gmde) and the subject was estabbshed 
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tory group of grea^ than 

effects, and the magnitud _ 2 63 p = -02). This finding suggests 

those of the auditory cue group ( ■ . P j-j paralinguistic chan- 

that a combination Expectancies, 

nels is most effective in the commu . , ^ auditory modaiities, the 

As to the difierentiai efiecuveness o the ""“J“„2tory cues alone 
data are equivocal. One “f meant, of 

ate more important than visud cues a _t y ^ 

course, the noncontent or parahngui P ^ An alternative inter- 

menters gave identical mst^efions *0 P,„,e behavior in 

pretation, however, suggests that subjects as so peculiar and 

their experimental sessions may av negative conformity to 

■•unnecessarily” unfriendly that rea<Ue^d 

their silent expenmenters S'; j^ss speculative. (We do 

tions must at this time be ^ jj j Tart [1964] that the auditory 

S::;enrre’rri"trot— expectancy of experimenters 
in hypnosis research.) 


temporaIi localization 


VlrUKAJ-( 

' in the preceding section w^discussed of s.. modajjfies 

in the commumcation of expen P j ,entional cue production, 

had been emphasized by observe^ of Hms ot nommunicated 

In this section the question of “P ^aLsted that the commumca- 

willbe discussed. Some of the o s experimenter-subject neg^ 

tion of expectancies occurred very eaj^ty -^Ui 

tiation. Otters felt that this — " observers were essenUaUy 
subjects began making ‘»=‘^.[.“P.°";“aradigm with positive reinforces 
suggesting an operant Xcts' emission of expect^ 

emitted by experimenters in resp . ^ 'g joUow the occurrence of 

responses. Negative i„ quEstion these events undoubtedly 

unexpected responses. In ‘ho ^ ’ intentionaUy trying to 

did ^cur, since the o^PomnonteR we nonverbal reinforcements^ TOe 
their subjects and oonscously emp ,0 , earn whether 

purpose of the data analysis to b p representative condiuons of 

LL the more ecologicaUy for the operauon 

unintended influence, operant cmi*hon.^S^^^^3l_ P<,<je, Vikan-Klme, & 
of experimenter expectancy 

Persinger, 1964). mnteted at the time, those three 

From the experiments criteria: (1) that experimented 

lected for analysis that -"ot ‘h= M g photo-rating task 

contacted their subjects individuaUy u g 
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on a rectangular board so that subjects could rate aloud the success or 
failure of the persons pictured without expenmenters’ handling the photos 

Six of the expenmenters were randomly assigned to the control group 
and were led to expect photo ratings of —5 from their subjects The re 
maimng expenmenters were all led to expect ratings of +5 and were 
randomly assigned to one of the following three experimental groups ( 1 ) 
Visual cues These six experimenters were fully visible to their subjects but 
remained entirely silent after greeting subjects and handing them their 
wntten instructions (2) Auditory cues These six expenmenters were per- 
mitted to read their instructions to their subjects but were shielded from 
subjects’ view by sitting behind a screen immediately after greeting their 
subjects (3) Visual plus auditory cues These six expenmenters read their 
instructions to their subjects and remained m full view throughout the 
expenment This group was identical with the control group m procedure 
and differed only in the induced expectancy Each expenmenter contacted 
an average of 7 5 subjects 

Magnitude of expectancy effect was defined as the difference between 
the mean photo rating obtamed by each expenmenter of the experimental 
groups (+5) and the mean of the mean photo ratings obtained by the ex 
penmenters of the control group (—5) 

Table 16 6 shows the magnitude of expectancy effect for each experi- 
menter of each experimental condition Negative numbers indicate that 
those expenmenters’ obtained ratings were m the direction opposite to their 
expectancy The experimenters of the visual cue group showed no effect of 
expenmenter expectancy The auditory cue group of expenmenters showed 
significant expectancy effects (( = 3 19, p = 005) The visual plus audi 


TABLE 16-6 


Magnitude of Expectancy Effects Under Three Con- 
ditions of Cue Communication 


COMMUNICATION CHANNEL 


Visual Auditory 

57 1 35 

42 98 

09 83 

- 16 79 

~ 64 62 

- 71 47 


84 


Visual Plus Auditory 

2 55 
2 28 
2 n 
1 61 
1 58 
0 62 


1 79 


Weons — 07 
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2H 

(mean difference) for the first photo alone, and for all ten photos together, 
for each of the three experiments. In addition, Table 16-7 shows, for each 
experiment, the t and p level (one-tail) as well as the number of experi- 
menters and the mean number of subjects contacted by each. 

In the two studies having the larger number of experimenters, the 
magnitude of expectancy effect (mean difference) was somewhat greater 
for the first photo alone than for all ten photos combined. For all three 
studies combined, the grand mean difference based on the first photo alone 
was 1.34, and that based on all ten photos was 1.23. This finding clearly 
indicates that operant conditioning is not necessary for the communication 
of expectancy effects. Masling (1965), in his study of examiner effects in 
influencing subjects’ Rorschach responses, was also unable to show that it 
was a pattern of examiner reinforcement that accounted for subjects’ biased 
responses. 

Comparison of the ts shown in Table 16-7 and their associated p levels 
does show that expectancy effects are more statistically significant when 
comparisons are based on the differences in ratings of all ten photos. This 
was due to the increased stability of the mean differences, resulting from 
their being based on ten times as many actual raw scores. The combined p 
of the mean differences based on first photos alone was < .03 (z = 2.01 ) . 

Figure 16-1 shows the grand mean photo ratings for each treatment 


MEAN RATING 



FIGURE 16-1 

Mean Photo Ratings Obtained in Sequence 
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identical instructions, (2) that expenmenters and subjects be m full view of 
each other throughout the experiment, and (3) that there be one group of 
expenmenters led to expect photo ratings of +5 while another group was 
led to expect ratings of —5 

To test the hypothesis that operant conditioning, as commonly de- 
fined (e g , Krasner, 1958, Krasner, 1962), was necessary for the operation 
of expenmenter expectancy effects, the following analysis was made For 
each of the three expenments, the mean photo ratings obtained of the 
first photo only were compared for the -f 5 and —5 expecting expen- 
menters If the differences in ratings obtained by the oppositely outcome 
biased experimenters were as great on the first photo as for all ten photos, 
we could reject the “theories” of expectancy commumcation which require 
operant conditioning as a necessary condition, since no reinforcement was 
possible until after this first rating 

To test the hypothesis that operant conditiomng augments expen- 
menter expectancy effects, the following analysis was made For each of 
the three experiments the mean ratings obtained by expenmenters of each 
treatment condition were plotted for each of the ten photos in sequence 
Magnitude of expenmenter expectancy effects, defined as the difference in 
mean rating, should show an increase over time if operant conditioning 
served to augment the phenomenon 

Table 16-7 shows the magnitude of expenmenter expectancy effect 


TABLE 16-7 


Effect of Experjmenter Expectancy on Ratings of the 
First Photo Alone and of All Ten Photos 


Fxperimenf 

1 

II 

III 

N of Es 

10 

12 

8 

N of Ss per E 

21 

7 

n 


First Photo Only 

Mean difference 

0 71 

2 16 

0 89 

t 

1 76 

1 50 

0 74 

P 

08 

08 

25 


All 

^ Ten Photos 

Mean difference 

0 50 

1 79 

1 30 

t 

2 19 

4 97 

3 94 

P 

03 

0005 

005 
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Communicanon oi - 

h,s subject, the results of the exper.ment 1,^ 

very special tinporta^ce of the ^ ^Pj^^ conditiomng 

been suggested by „ho found that the sex of the expen- 

andby Stevenson and Odom ( ’ though the experimenter left 

menter affected the subjects p before the subject began responding 

discover the “how” of the communication of expectanci 


the problem of signal specification 

tf there were one, when the 
Even if we knew the ’g j j,, respond m a certain 

expenmenter umntentionally s'g"® s which experimenters 

way, and even if we could speci y responses we would still be 

would successfuUy influence then ^bj ? Exactly what 

left with the basic f ^hen he expects a certam response 

does the expenmenter do diff ^ ,5 the opposite response'? 

compared to what he does wh P dilation of the nostnls, 

No upward movement of the j^bjects as they were in the 

have yet been shown to be the cn 1 g analogy too far Hans, after 
case of aever Hans Nor .b, tnpjnng 

all, had omy to receive a s'g"'*' P^„,nemers to their subjects that they 
of his foot A simple signjd by on ^p^ ^ hypothesis, since we saw 

S'™— ““ ■ 

“'“s « .0 » “S'!'™- 

interacting with subjects for *ey PP^ P 

ployed the onginal five molar '' ^^^.h experimenter had been ra e 

Lch of his interacuons with a su j manner, and fnendhness 

on his dominance, likabihty, pservers of an expenmenter s inter 

The ratings made by the «« negative ratings of the succes 

acuon with a subject from ^ the ratings made of his behawor 

of others (-5) could be he expected positive raUngs (+5) 

when contacting a subject t™?" " jmall compared to ‘h® “y 

These difierence scores tended to q ^g g illustrates this fact by 

found among different “P“‘ obtained difference = ™ 

showing for each vanable !"“ h'reatest difference oblained by any 

means of different “pnnnwnters and h g „penmental nondiUon 

single expenmenter between subjectsj^ withm-expenmenter vanaUon were 

Those variables showing the g 
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condition for photos grouped in sequence, for all three expenments com- 
bined (unweighted) Inspection of this figure shows that magnitude of 
expenmenter expectancy effects, defined as the difference in mean rating, 
changed very httle over time (p > 50), suggesting that verbal conditiomng 
need not serve to augment expectancy effects 

In our earlier discussion of Weick’s classroom experiment on ex- 
pectancy effects we noted that the observers’ reports suggested the opera- 
tion of differential reinforcement of expected and unexpected responses 
by subjects It is of special interest, therefore, to note that in this study, too, 
significant expenmenter expectancy effects emerged before any reinforce- 
ment was possible The magmtude of expectancy effect on the very first 
photo was +5 00 (p < 02, one-tail, r = 2 84, d/ == 8). 

Figure 16-2 illustrates that for Weick’s experiment the very first 
responses were more affected than were the subsequent responses Magni- 
tude of expectancy effect, after the first response, was fairly stable through- 


MEAN RATING 



oto Ratings Obtained in Sequence (Weick's Data) 


emDloverf^nd FT ***^**^ Standard 20-photo set was 

'xpectarcy cfTects manifest themselves so 
funherstudvnf it, l""™ ™P<>«=nt implications for the 

he verv hnef expectancy effects It suggests that dunng 

the very bnef penod in which the expenmenter greets, Jnts. and instructs 
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ancy effects (> +1.00). J “or^^ver^^ expectancy effects 

> ll.OO), and those f was significant at the .05 level 

« -1.00). None of these mean differences W B ,s computed had 

for any of the variables listed. However, ascribed to chance), it 

an associated p < .20 (too “’“'y behaved^ differently toward their 

appears that on the whole “Pe i,piieved them to be success- or failure- 
subjects depending on whether ‘ ^^^^cs of the positively biased 

perceiving subjects. The profile of d unbiased 

experimenters was JP ^ ^ tended to be opposite to *e 

experimenters (rho = -l-OO. P - ;02)- ^ p ^ .20). The 

profile of the negatively “P^" cp did not differ from the profile 

profile of difference scores of this Mterp j positively biased 

of the unbiased group (rho - ’ P professional but more friendly 

experimenters behaved tLy believed to be fadure per- 

and likable manner toward those 1 ^ J just the opposite 

ceivers (“-S’s”). The unbiased somewhat more dom- 

configuration of '’^'’avior and >n ad*t. t^cegh the posi- 

inanUy toward their “-5 especially mce to the subjects 

tive biasing experimenters we« ^ S ‘y^ ,yc ^biased experimenters were 
they believed to be failure y^jd to avoid ueatmg then sub- 

just the oppos'‘«-P"'’^P®J”” nwaUve biasing experimenters seemed 
iects differentiaUy. The behavior o S j^y.^ rye unbiased experi- 

to vary most as a function and professional toward their 

menS^. they were tlTtosed experimenters, they were ako 

“+5” subjects. But like to p ^ Uajjye either of to other gro p 

less likable toward their +5 . ycyaved more actively vis-a-vis ton 

experimenters, the reverse ” „{ this group of s 

“^5” subjects. The <i'"^:^%aorts to avoid affecting then 

“&S-‘JSi:vior tor exam,e 
It seems unlikely that a simp lowered photo ratings 

towarT: -5” subjlt. 'ea^ to — ng to ^ , tions 

would expect if bias were to „ of their 

between subjects’ photo taUngiantoh ^ ^cre obtained by ex 

behavior. Higher ratings < Uss 
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TABLE 16-8 


Maximum Obtained Differences in Experimenter Be- 
havior 



Wiibm 

Between 

Behov/or 

Experimenters 

Experimenters 

Dominant 

60 

3 70 

Likable 

80 

4 20 

Activity 

90 

4 00 

Professional 

1 60 

4 95 

Friendly 

2 00 

4 80 

Meons 

1 18 

4 33 


also those showing the greatest between experimenter vanation (r = 91, 

P=03) 

Table 16 9 shows the mean differences m expenmenter behavior vis- 
a-vis those subjects from whom photo ratings of +5 were expected and 
those from whom ratings of —5 were expected These mean differences 


TABLE 16-9 


Differences m Experimenter Behovior as a Function 
of Expectancy 


MAGNITUDE 



Positive 

Effect 

N= 8 


Behavior 

Mean* t 

P 

Dominant 

+ 04 


Likable 

- 25 1 68 

15 

Activity 

- 11 


Professional 

+ 19 


Friendly 

- 52 1 60 

16 


OF EXPECTANCY EFFECTS 


No Effect 
N= 8 


Negofive 

Effect 

7 


Mean* t 

P 

Meon* f 

P 

- 18 1 94 

10 

- 24 1 98 

09 

+ 14 1 76 

13 

- 19 1 66 

15 

+ 04 - 


+ 36 2 27 

06 

-20 ni 

_ 

- 31 1 55 

17 

+ 44 1 81 

12 

- n - 

- 


* (Mean roting 





Communication oC Experimenter E^ectancy 


297 


were descnbed For the five behaviors we have been discussing, the mean 
ratings of expenmenters contacting “ — 5” subjects were subtracted from the 
mean ratings of experimenters contacting subjects These difference 
scores were correlated, as before, with the photo ratings made by “—5” 
subjects subtracted from photo ratings made by “-f5” subjects When 
judgments of expenmenter behavior were made of only the brief prein- 
structional period, none of the correlations were sigmficant, regardless of 
whether the behavioral observations were based on the silent films, the 
sound track, or the sound films When judgments of expenmenter behavior 
were made of the instructional penod, by observers of the sound film, the 
only correlation to reach significance was the same one that reached sigmf- 
icance when the possibly contaminated observers had been employed Ex- 
penmenters showing more-dominant behavior toward their subjects 

tended to obtain the expected higher photo ratings from them The correla- 
tion was -f- 50 (p = 04, = 16), very close to the value of 47 obtained 

by the onginal observers When the observations were based on the silent 
films alone, experimenters showing in their motor behavior an increase in 
professional manner toward their ‘'+5*' subjects relative to their 5” 
subjects, obtained the expected higher photo ratmgs from them (r = -j- 64, 
p =z 008, df = 15) None of the differential behaviors of the expenmenters 
toward their “+5" or “—5” subjects as judged from sound track alone 
predicted significantly the differential photo ratmgs subsequently obtained 
from “-f-5” and “—5” subjects 

It may be recalled that these samples of observers had made ratings 
of other aspects of the experimenter’s behavior than just those five we have 
been discussing Table 16 11 shows the significant correlations (p < 10) 

TABLE 16-11 


Differential Instructional Behavior of the Experimen- 
ter as Predictor of Subjects' Differential Responding 


OBSERVATION CHANNEL 

Visual Plus Auditory 


Visual 


Professional 

+ 64 

Not acting important 

+ 50 

Honest 

+ 43 

Courteous 

+ 41 

Mean r = + 50 

Wean infercorre/o/ion 

= + 41 


Talkative + 63 

Dominant + 50 

Dishonest + ^3 


Moan r = + 52 

Aleon intercorrefotion = + 27 
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table 16-10 


Correlations Between Subjects' Photo Ratings and 
Their Experimenter's Typical Behavior 


Behavior 

r 

P 

Dominant 

-.34 

.005 

Likable 

+.08 

_ 

Activity 

+.18 

.13 

Professional 

-.24 

.05 

Friendly 

+.20 

.09 


dominant, likable, and less active On the basis of the data presented in 
this section, we still cannot say how changes in expenmenter behavior lead 
to changes in their subjects’ responses Of considerable interest, however, 
was the finding that experimenters’ expectancies lead to changes in their 
own behavior regardless of whether they bias their data positively, nega- 
tively, or not at all r o 

Given that a more dominant experimenter subsequently exerts greater 
expectancy effects on his subjects, as we saw in the last chapter, if he 
^comes somewhat less dominant vis-a-vis a subject from whom he expects 
♦iia,. if subject will tend to rate the photos as less successful, 

negative or reversed expectancy effects This can be 
IS tn ^ '? Perhaps a simpler way of expressing this relationship 

toward^ SI h ® between the difference in behavior manifested 

differlct 

havior “don, subsequently obtained from them For the be- 

mean thatTa = 03- = 21). which 

Inward '“ward a “+5” than 

than from his ■•-5”"subjeets" Of th "+/’ 

cussion this U 75 .C 1 * behavioral vanables under dis- 

more-dominant exo ^ ^ reached statistical significance Although 

to obtain higher photo ratiiL^v^wh 

does suppest thp 1,1 ^ should be is far from clear, but it 

tionlevff (Kelson, 196*) '••<= =ffoo‘s of the subject’s adapta- 

judgJemso7flvrnrugLrr^^^^^^ 

LrrrrrTr '.h - rrv““ot 

coreelabons T„ m 1 r T “"^^reations that would show similar 

correlations In the last chapter, observations by uneontaminated observers 
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TABLE 16-12 


Differential Preinstructional behavior of the Experi- 
menter as Predictor of Subjects Differential Re- 
Spending 


Visua/ 

Trunk gestures 
Important-acting 
Behaved 
inconsistently 


observation channel 

Auditory 
Loud — 49 


Visual Plus Additory 


-50 

- 48 

-47 

- 48 


Mean r == - 49 


Loud 

Hand gestures 
Speaks 
distinctly 

Mean r = 

Meon 

intercorre/ation - + 38 


+ 65 
+ 47 

+ 46 
+ 53 


Mean r = 

Mean 

mtercorre/ation a + 09 

to he useful e^Ser'fXng-n cL^l 

yet been discussed is ® ® _ectancy he has of a given subjects 

discrepancy as a funcuon o 5 ub,ect’s subsequent response 

response can be to predict that bj discrepancies could be 

For 17 of the behavio al „ expenmenter showed in mter- 

computed The mean channel discr p y channel dis- 

actingwith a “-5” subject subject The resulting 

crepancy he showed in tn^taeting Jdh « 

difference scores were subtracted from the mean 

photos subsequently .J. For the premstrucUonal penod alone 

photo rating given by ‘+5” subjects For available based 

Ldfortheinstrucuonalperioda one 7 

on algebraic channel ^ ^ere available based on abs^ 

ir ‘7::; 

shows the shown 

5 " "‘paS^; tK^ob"7ad® m the 
subjects’ subsequent photo menters who show <1 greaWr 

preinstnictional period alone, degree of casualness bu 

absolute channel <i-sa°tdance m tou d g ^^^jects subsequenUy oh 
cordance in their hkab.hty {Torn these subjects (R - 85. 

tamed the expected higher photo rati g 
p<001) 
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between differences in instructional behavior vis-a-vis and “ — 5” 

subjects and differences in photo ratings subsequently obtained None of 
the correlations based upon observations of experimenter behavior m the 
auditory channel alone reached a p < .10 

Withm each of the other two channels of observation the variables pre- 


dicting subjects’ differential responses as a function of expenmenter ex- 
pectancy were not well clustered Within each channel the mean correlation 
predictmg expectancy effect was higher than the mean intercorrelation 
Judging from the visual-plus-auditory channel, experimenters who behaved 
m a more talkative, dominant, and “dishonest” way toward subjects from 
whom they expected -f-5 responses tended to obtain such responses Judging 
from the visual channel alone, experimenters who acted m a more profes- 
sional, more courteous, less important, and more “honest” manner toward 
their “-}-5” subjects tended to obtain the expected responses from them 
The most puzzling aspect is the very different meaning of “honest” when it 
IS judged from the visual channel alone compared to the visual-plus-auditory 
channel As we would expect from the opposite directions of the correlations 
between honesty and subjects’ responses, treating a subject in a more honest 
way judging from the visual channel alone is seen as treating him in a less 
honest way judging from the visual-plus-auditory channel (r = — 62, p 
< 01) These findings do not solve our problem of finding the key to the 
communication of expectancies, but there is a lesson for future studies of 
interpersonal communication Adding a channel of communication does not 
simply strengthen the meaning of a message — it may, in fact, reverse that 
meaning 


Table 16-12 shows the significant (p < 10) correlations between the 
differential premstructional behavior shown vis-a-vis and “—5” sub- 
differential responses subsequently shown by these subjects 
u ge rom the visual-plus-auditory channels, experimenters who showed 
more^^ an ^ gestures and whose speech was more “loud and clear” toward 
toward their “—5” subjects obtained more positive ratings 
* an from their ‘ —5” subjects Again we find a judgment of 
behavor reversed as a function of the channel o! commnn.cauon 

^ sound track alone, experimenters obtained relatively 

thlywer^teloT 


channel alone, experimenters who showed less 
their “- 1 -“;”^’ vf ““d behaved less inconsistently toward 

^^5”stbjecK^' 


In the last chapter the concept of channel discrepancy was described 
Because there were observations of behavior based only on the visual 
channel and observations based only on the auditory channel, a difference 
could be computed Such characteristic channel discrepancies were found 
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perimenter differently j" conytyin^ 

— t:“Sie “ 

treatment by the expenmenter tnay b q jhe experimenter;s 

whether a subject goes accept with confidence is 

hypothesis. What has been lea communication processes are enor- 

the be stUl more eompkx when the com- 

mously complex and Inal in y y 
munication is unintentional. 

IEAKNING to communicate UNINIENnONAEUV 

If. after hundtede of hduts 

system of unintentional unintentionally? Perhaps the taowl- 

“know” how to influence their ) a tacit knowledge. As 

edge of interpersonal influence p cannot teU (p- 

(1962) has put it. “There are ^as whether an ex- 

601). One question that could „ jjs subjects later on in the 
perimenter “knows” better how to mfl«e«e_^ 

process of data collection. If an yld be reasonable to think 

Lai influencing later than h^^^’ I'aTned phenomenon. That w^ 
that in part, unintentional influen ^gns. Pfungst ‘me 

just what happened in the case of 1 ^^^pcad they becam 

br:u^:Suf A -o Hans When to stop Ins 

‘‘‘"’'’'^^-the chapter dealing wi^th-^^^^^^^^^^ 

L”U"o' “Sriment were ■"1heCt'hi'“L ex- 

expectancy than were subjects collected with Suzanne 

"SrX«”f ^expenLnters’ -P--^f^-Lncd p was less than 
experiments with a total of 54 not always possible “ 

“"t weick’s study reporied 
effects when the two expenmente^ ^_r 

earlier subjects in the ^^fl-XL^tTmong her lower status «p"'" 
chapters ago, showed no or . ters to increase their p g 

but did show higher status expenm (p ^ .01). Alt g 

fects as a function of number ol su j 
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TABLE 16-13 


Differential Channel Discrepancies as Predictors of 
Subjects' Differential Responding 


EXPERIMENTAL PERIOD 


Preinsiructional 


Behovior 

r 

P 

Casual 

+ 74 

003 

Likable 

-.57 

.04 

Multiple R s 

.85 

.001 


Instructional 


Behavior 

r 

P 

Honest* 

+.46 

.06 

Dominant 

+.41 

.10 

Multiple R s 

59 

.04 


This wos on olgehrcic disrreponcy (visyol > ouditory). All other 
ignorT'’''** that is, sign of discreponcy wos 


Based on observations made m the instructional penod alone, those 
ex^nmenters who showed greater absolute channel discordance in their 
showed greater visual than auditory honesty 
- , “—5” subjects, subsequently obtained the 

S “+5" “-5” 

tn . 1 . ’ ^ seems best to forego the speculation requned 

demon^T^r specifics of these findings In general, however, these results 
nek nf rnTT^L ^ of changes m the discrepancies between chan- 

AHHitin predictors of subsequent interpersonal influence 

acting with th^ sound motion pictures of expenmenters inter- 

sSc llu'h "= ■" We may or may not find more 

subiects whit it expenmenters communicate to their 

mXotmean Z h fi"*ng such spee.fic cues 

ere are no such cues hut only that we do not yet know 

able to find them If, in fact, 


Zlt™' l-"‘'”‘Sna.mg systems to he 


mere were no specific cue«! tn h. 7 V 7 

behavior of thp ^-rr. found, then more molar changes in the 

rXeet beh,i m”'" nonspecific mfluencers of 

^SmueTp:rs"r:atmhr 

exnenmpnt^^r however, that these changes in 

lects as to how thev m' conveyors of information to the sub- 

on Lco^rToJ n subjects who later go 

on to confirm or disconfirm the expenmenter’ ' 


•’s hypothesis affect the ex- 
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the evidence is not conclusive, it does seem that, on the whole, later-con- 


tacted subjects are more influenced by the experimenter’s expectancy than 
earlier-contacted subjects. Over the course of an experiment, experimenters 
may learn to communicate their expectancies more effectively. 

This learning hypothesis is strengthened somewhat by the findings of 
the studies on experimenter-subject acquaintanceship. The two studies sum- 
marized earlier found greater acquaintanceship associated with greater ex- 
pectancy effects. In part, of course, this may have been due to the greater 
willingness of people to be influenced by prior acquaintances. In addition, 
however, acquaintanceship implies a longer joint history with greater op- 
portunity for learning how the interpersonal influence process operates 
with the specific other. Acquaintances, presumably, not only have greater 
reinforcement value for each other but probably can better read each other’s 
cues, unintentional as well as intentional. 


If the experimenter were indeed learning to increase his unintended 
influence, who would be the teacher? Most likely, the subject would be the 
teacher. It seems to be rewarding to have one’s expectations confirmed 
(Aronson, Carlsmith, & Darley, 1963; Carlsmith & Aronson, 1963; Harvey 
& Clapp, 1965; Sampson & Sibley, 1965). Therefore, whenever the subject 
responds in accordance with the experimenter’s expectancy, the likelihood 
IS increased that the experimenter will repeat any covert communicative be- 
havior that may have preceded the subject’s confirming response. Subjects, 
Tn«n’ unintentionally shape the experimenter’s unintended com- 

tn the experimenter influence his subjects 

flint ii^w manner, but his subjects may well evoke just 

hf as expected. As 
andof Pfungst (1911) suggests, such com- 
n may not fall under what we commonly call “conscious control.” 
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Asbehav.o.alsc.en«sts«hatsho^^^^^^^^^^ 

presented in this book’ Three d‘Sere“ observed ( 1) the incredu- 

of the data from this *>ook have actua reactor (who may 

hus. (2) the gleeful, (3) the ,5 us, so much nonsense 

not have read this far) feels vague y ^ppiy to him 

and that if it is not d’thl but may read no further) 

The gleeful reactor (who may have behavioral sciences were 

has -known all along that “Pf""'"Ve empmcal research He is glee- 
nddled with error” He does not do Ik P ^uiental evidence pre- 
ful because, paradoxically, he read ep,stemology that knowledge of 

seated in this book his luahfica .on fo jnsjp.s^ ^,ur aU if 

the world comes through revelation rather « h.s 

observation is subject to observer mfluen ^urms is 

eschewal of observation'^ The ,h.s far more or less cntically 

intentionally positively ®''“'“®'‘ve) researeh might have been 

and has woUered a bit whether som^ of 

affected by his own expectancies although skeptical by 

Much of what follows is A interested, is not overdeter- 

training, is not incredulous, wh ■ ® ,,uut his own research, is n 

mincdly gleeful, who, although j I, ,s tor the reader who 

contem^ting giving up the soienti rp 5uy ‘ Let it be 

agrees with Hyman and his an advanced state of a science 

noted that J den^onstrauan of err” rnark”^^ aware of 

All scientific inquiry is subject ‘O ’ j^duce it, ‘b™ 'o S 

this, to study the sources in an jata” (P 

norknt of the errors concealed in the data tp 
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Generalization of our conclusions to 

sophistication than these subjects consoling, for the mature and 

caution. It would be dangerous, ho > ^ to the opera- 

sophisticated interviewer to affecting the varL group of interview- 

tion of the same “"tnris a matter of fact, the available 

ers covered by the studies wear^heremW , abject 

"ble'eC of a careless sorl he is probably equally subject to cer- 

tain biasing errors (1954, pp. ix x) . 

t -. 1 , thm Hart If anything, our data suggest fmrly 
Indeed, we can go further ‘ban ^ ^ 

ss r.rX" w — «' “ " *' 

— f 

experimenters whom we have s u , jybject’s response than the 

huLn) seem to be much more mmres edm the aub, ^ 
survey interviewer apparently is m h The expenmenter, 

1954, p. 270). But that seems not ha d t if he 

as compared to the iol At least to some extent the 

performs poorly, can simply ‘“H® depends on the responses his sub- 
professional career of the "if At first glance this may seem 

jects give him in the experimental situation- At a ^ler 

far-fetahed. Actually it is <1"“® /o, of heavenly bodies cicely 

sciences. The behavior of a noble g ^ iide 

afiect the ®®'®" to something to report or gu 

behavior. It gives, or does no g . 

his next experiment or observa lo • j„oipai investigator, P"! ® ® “ b 
If the experimenter is not the p P jj,ay still depend, m 

the principal investigator, his P™ ®“^ bis subjects’ responses. 
morfhan the survey interviewer s, °”^"bl principal investigator to 

bears a much more special relato^P ^ ^/student is to oriy 
the interviewer bears to his e P y ® The interviewer may 
employee or one of a handful ®77f ' rimenter is Ukely to leam ^ 

thoLands of employees. The bis subject’s responses^ The 

mediately what his employer’s "0 ,„n absent 

interviewer’s feedback may c . j investigator or b more 

short, the experimenter, be he P""®'f f^nwet If he cares so to^ moie 
has much more at stake than does t experimental 

about how his subject per be may be more likely to ij 

seems reasonable to suppose that ® ^ban the typical intervie 
something of this concern to 

Ukely to do. , jny with certainty bias their 

At the present time we ^ore or less hkely to 

experienced professional expen 
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THE GENERALnY OF EXPERIMENTER EFFECTS 

How pervasive are the unintended effects of the experimenter on the 
results of his research, and how much ought we to worry about them in our 
day-to-day research activities'^ The answer to the first part of this question 
seems simple We don’t know No one knows It seems reasonable to sup- 
pose that there may be expenmenters doing expenments the results of 
which are unaffected by the experimenters themselves Unfortunately, we 
don’t know who they are or which of their expenments, if not all, are im- 
mune to their own unintended effect This lack of specificity in our knowl- 
edge suggests the answer to the second part of our question It seems more 
prudent to worry than not to worry about expenmenter effects in our day- 
to-day research 

One type of expenmenter effect, that of his hypothesis or expectancy, 
has received our special attention in this book For this special case of ex- 
perimenter effect we can sketch out the evidence bearing on the question of 
Its generality After the manner of Brunswik’s conception (1956) of the 
representative design of expenments, we may specify the samphng domains 
of expenmenters, subjects, tasks, and contexts employed m the expenments 
descnbed in this book 


Experimenters 

Altogether, there have been well over 350 expenmenters employed 
1 ? Af wf described About 90 percent of these were males All but a 
nandtul (faculty expenmenters) were graduate or undergraduate students 
n a cases, however, expenmenters were academically more advanced 
an were t eir expenmental subjects Graduate student expenmenters were 
classes in psychology, education, biology, physics, engineering 
aw n ergraduate student expenmenters were drawn primarily from 
ourses m expenmental, induslnal and clinical psychology, statistics, and 
nLTll T”""' experimenters were volunteers, but m 

nrant I ^ ^ ^hole was urged by its instructor to participate — a 

^ essentially nonvolunteer populations (Rosenthal, 

expenmenter samples were paid for their participation, but 
many were not r r 

sampling of experimenters has been fairly broad, it has 
^ populations Does any of the work 

reported, then, have any real relevance to the “real ’ expenmenter*? The 
gleeful reactor mentioned earlier may too quickly say “ye^’ The incredu- 
lous reactor may too quickly say ‘ no • In hJs discussiL of the generality of 
interviewer effects, Hart (obviously a realist, c reactor) put ft this way 
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pop—.. .0 - — “ ”‘l““ '•* " ’ 

different laboratories were employed AbU^ 

The subjects employed m o ^ to be uttle risk in 

typically used in behavior rese ’ . tj.jo.„eMral. Of course, nonstu- 

generaUzing from our su P 1^^ behavioral research, but tins is 

dent subjects ate employed now a ^ existing science 

so relatively rare that McNemar wa sophomores” 

of human behavior is largely the science 
(1946, p. 333). 

TWO 1, no O—a ™j 

mental situation is the task the su j jor the degree of 

quently employed task has been that of ^ ^ ; The exact in- 

tcJs or failure ‘he person p.ctued^ to edmimster 

structions to the subjects, f ® |tion hLe aU been varied. Neverthe- 

task, and the exact mode of " jte of the fact that the 

less in spite of the variations in this task single task can be 

task is a fairly typical one «t P^y^hol p psycholo^sts have 

regarded as an adequate other tasks have been em 

asked their subjects to perform. Aooo™'"|/;di^,d and projective psycho- 

ployed, including verbal cond.t« and Skinner 

lorical tests; and for animai j 

"““Most of the studies hescrib^- “ d two 
of North Dakota, the Ohio State out at different times during 

truer universities in Ohjo- They ^-"tns. Length of h-e elapsmj 
the academic year and d"r‘ng ^ last subjects in a 8"'"“ of 

between the contacting t months. In most cases a nu.nb«^^ 

feted considerably. These rang experimenters) to in 

Sts were simultaneoudy cmitarted_^hy„ P lable^ Some^of the 

rooms barely large enoug ^ microphones in view, 

rooms had one-way-vision mirrors 
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subjects’ responses than less experienced expenmenters, although all the 
evidence available suggests that more professional, more competent, higher 
status expenmenters show the greater expectancy effects In any case, we 
should note the trend that as experimenters become highly experienced they 
become less and less likely to contact their subjects directly As investigators 
become better estabhshed they are more and more likely to acquire more 
and more assistants who will do the actual data collection These assistants 


range from an occasional postdoctoral student through the vanous levels of 
graduate students Increasingly, even undergraduate students are collecting 
data to be used for senous scientific purposes Undergraduate research 
assistants, for example, are the only ones available at many excellent 
hberal arts colleges with active research programs in the behavioral sciences 
For some time onginal research has been required of at least some under- 
graduate candidates for honors degrees, and this trend is increasing More 
and more we shall probably see undergraduates collecting data for serious 
purposes under the expanding programs supported by the federal govern- 
ment as part of the movement to encourage the earlier selection of careers 
m research The Undergraduate Research Participation Program of the 
National Science Foundation is a prime example 

With more and more “real” data being collected by less and less ex- 
perienced experimenters, it appears that our student expenmenters are not 
as unrepresentative of the “real” world of data collection after all But 
suppose for a moment that it were indeterminant that there were “real” 


expenmenters in the world who were like the graduate and undergraduate 
students we employed How senously would that restnct the generality of 
e ata presented*^ Of course, we could not be certain of any answer to 
that question But in a relative sense, it does not seem far-fetched to use 
Lee student and faculty researchers — certainly much 

iQAi ^ Marcia has pointed out in personal communication, 

wt» tinu using a Sprague-Dawley albino rat as the model for man But 
< 5 nntinnL ®”®ugh of consequence about human behavior from both 
ahmit ♦L" A prague-Dawley that we do not feel too uncomfortable 
hie thf n " ^gree of generalization If these generalizations seem tena- 

clneS“ser:,eTable‘'“" 


Subjects 

studies descnhpH 2,000 human subjects employed in the 

female Most of the sub- 

ductorv n’sveh I greatest single contributing course was intro- 

1 d^vT but many were 

£ y ir ins rue ors to participate and so became more like a non- 
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fonned) response produced or as the difference between that raw response 
and the mean of any other group. 

B. ‘‘Correct value.” The “correct” or “true” datum is established 
by reasoned fiat. In some cases there are reasonable bases for the choice of 
the true or correct value. In a censuslifce investigation of age, birth records 
may serve as the “correct” value against which subjects’ responses may be' 
compared. In a study involving college grades the registrar’s records may 
serve as the criterion against which to compare subjects* statements of 
grades. In both of these examples, we should note, it is entirely possible 
that the official records are “in error” in some absolute sense and that the 
subject’s response is more accurate. But on the whole, we are more in- 
clined to trust the official bookkeepers of society, not because they are 
error-free, but because in many situations they seem to have the “best” 
data most of the time. 

But there are no books kept on a given subject’s pursuit rotor per- 
formance or his political ideology (but affiliation, yes), or sex life, or 
verbal learning, or small group interaction patterns. We find ourselves hard 
pul to establish a criterion value. In survey research (Hyman et al., 1954) 
this is often done by sending out more experienced data collectors whose 
obtained data are then assumed to be more accurate than those collected 
by more inexperienced data collectors. That this may be so is reasonable 
but is so far from having been well established that it may be a misleading 
assumption. Similarly, in anthropological research, it has been suggested 
that better rapport with informants leads to more accurate data (NaroU, 
NaroU, & Howard, 1961 ; NaroU, 1962). This, too, is a reasonable assump- 
tion but probably also a risky one. Realistically, we must content ourselves 
with the fact that in most behavioral research the “true” data are unknown 
except as we obtain them in behavioral inquiry. 

One solution that may serve for the time being is the democratic but 
not very satisfying one of assuming equal likelihood of error in all experi- 
menters until shown otherwise. On the basis of this assumption, we take the 
mean data obtained from roughly comparable samples of subjects to be our 
“true” mean. The more experimenters that have collected such data, in 
fact, the “truer” wiU our “true” mean be. 


II. Experimenter Bias 

Experimenter bias is defined as the extent to which experimenter 
effect or error is asymmetrically distributed about the ‘ correct or true 
value. The measure of experimenter bias is some function of the algebraic 
sum of the deviations of that experimenter’s data about the correct value. 
It is, therefore, a measure of net error. 

We should note here that for a single subject’s score or a single mean 
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Some of the rooms were furnished so as to convey the impression that the 
occupant was a person of high status; some were furnished to convey the 
opposite impression. 

Earlier we asked the question of the generality of the effects of the 
experimenter on the results of his experiment. We are now in a position to 
conclude, at least for one type of experimenter effect (that of his hypothesis 
or expectancy), that the phenomenon may well be a fairly general one. This 
conclusion seems warranted by the variety of experimenter, subject, and 
situation or context domains sampled and by the fact that expectancy effects 
have been shown to occur in other than experimental laboratories. Some 
of this evidence was presented in Part I and some will be touched upon in 
the final chapter. The generality of the phenomenon of experimenter ex- 
pectancy effects suggests the need to consider in some detail the implica- 
tions for psychological research methodology. We will turn our attention 
first to the problem of the assessment of experimenter effects. 


THE ASSESSMENT OF EXPERIMENTER EFFECTS 


So far in this book we have found it sufficient to give only very general 
definitions of certain operating characteristics of the experimenter. In this 
section we shall see somewhat more formal definitions of some of these 
characteristics. Whenever we speak here of “an experimenter'* or “a sub- 
ject we imply that whatever is said applies as well to a homogeneous set of 
experimenters or subjects unless specifically restricted to the single case. 


I. Experimenter Effect 

defined as the extent to which the datum ob- 
ftf ^ ®^P®rbnenter deviates from the “correct” value. The measure 
of the ^^P^rimenter error) is some function of the sum 

^®'''3tions of that experimenter’s data about 
V ue. It IS, therefore, a measure of gross or total error. 

bv the exne^ defined as the performance or responses made 
“ow” ~e be applied to (1) the 

terms and'ctl ^ ^ t, ' conversion of the raw response to quantitative 

terms ^ a"y snbseqnc^^ transformation of the quantitative terms. 

the experiment h t behavior of the subject which 

m^etm re a"*- We mny use this term to 

before and nfie ^°*b ®'>s°lute and relative terms, both 

men, eomt transformation. For example, in an experi- 

tott 7 “pnrimentai groups and one or more "conirol" 
groups, a subjects response might be defined as the “raw” (untrans- 
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that in the hrst study described in that chapter (Table 12-1) those experi- 
menters whose early data were biased as to their central tendency (means) 
obtained subsequent data that were biased not only with respect to central 
tendency but with respect to variance as well. Variances obtained by ex- 
perimenters obtaining more biased early returns tended to be significantly 
smaller than variances obtained by experimenters obtaining relatively un- 
biased early returns (f = 4.06, ri/ = 6, 3, p < .10). It may be, then, that 
unusually restricted variance or hyperconsistency can serve as a clue to the 
possible biasing of central tendendes. 

When we speak of “hyper”-consistency or inconsistency we imply that 
we know the “true” or “correct” variance. The situation for variance is 
essentially the same as it was for the mean or any other measure of central 
tendency. We never really know the “true” value, but we can make rea- 
sonable choices of a “working-true” value. In a few cases we again can 
turn to public records from which “true” variances may be computed. We 
can use as our “true” value the variance obtained by some paragon ex- 
perimenter or group of experimenters. In our earlier discussion of “correct 
values” we pointed out some difficulties of this technique, difficulties that 
apply equally well for variances as for scores or means of scores. For prac- 
tical purposes, at this stage of our knowledge, we must probably rely on 
some method of sampling experimenters to arrive at some estimate of a 
“correct” variance. Such sampling may help us avoid the bias assodated 
with the employment of experimenters who, fortuitously, may be over- 
consistent or underconsistent. 

Before leaving this section, two kinds of experimenter deviation from 
normality of response distribution will be mentioned. Even assuming a 
properly consistent and unbiased experimenter, his distribution of obtained 
responses may contain too many high or low responses (skewness or 
asymmetry). In addition, his distribution of obtained responses may con- 
tain too many or too few responses at or near the mean. When we speak 
here of “too high” (or low) and of “too many” (or few) we mean it with 
respect to the normal distribution. Whether the “true” distribution is, in 
fact, normal is the same sort of question we have asked before when dis- 
cussing “correct” scores, means, and variances; and our answer is essentially 
the same. 

These two kinds of experimenter deviation from normality of response 
distribution have been discussed only briefly because, at the present time, 
we have no evidence that (hey are in any way serious for the usual conduct 
of psychological research. It is the rare psychological research paper that 
deals in any central way with the absolute magnitudes of skewness or 
kurtosis. It would seem interesting, however, to assess an experimenter’s 
distribution of obtained responses for these characteristics, since in real 
life situations these deviations may prove to be indicative of error or bias 
in the means. 
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we can only judge whether that score or mean is accurate or not if we are 
given a criterion of “correctness ” If the score or mean is accurate, well 
and good If it is not accurate, we cannot evaluate whether the inaccuracy is 
biased or not In a sense, of course, it is biased, since it must represent a 
net deviation from the correct value But we would have to have at least 
one other score or mean to test properly the hypothesis of bias If a sub- 
sequently drawn score or mean were to fall equally distant from, and on the 
opposite side of, the correct value, we would necessarily reject the notion 
of a biased data collector 


m. Experimenter Consistency 

Expenmenter consistency is defined as the extent to which the data 
obtained by an expenmenter from a single subject or sample vary minimally 
among themselves The measure of experimenter consistency is some func- 
tion of the sum of the absolute deviations of that expenmenter’s obtained 
data about his mean datum obtained The commonly used measure in this 
case would, of course, be the variance or standard deviation 

In the case of experimenter effect and experimenter bias we could take 
a sunple evaluative position we are likely to be against both In the case of 
expenmenter consistency the situation is more complex Whereas we may 
be against marked inconsistency, we should also worry about hypercon- 
sistency ^ ^ 

If the expenmenter is very inconsistent he is inefficient in the sense 
that he will have to obtam a larger number of responses to estabhsh a 
reliable mean value Such inconsistency of obtained responses may be due 
to random vanations m his behavior vis-a-vis his subjects, including minor 
eviations from both his programmed procedures and his unproerammed 
modal interpersonal style “ 

.n other hand, the experimenter is significantly wnf/ervanable 

1*^ he obtains, his increased “efficiency” is bought at the cost of 
possible bias has been well illustrated m the earlier cited 
S counts (Berkson, Magath, & 

ctontfir fi j workers showed that successive blood counts were 

>><= attnbuted to an ex- 

succpssivi. observer for the close agreement of 

counts sore t” ^ t observer's initial expectancy might be, his 

inilnl ctLci,, °° **"* In the absence of any special 

sionilici ^ reasonable that the early data might have special 

^vlr of subsequent counts Early data returns, as 

nuen H i f •'"‘‘="0'“ (rather than the variability) of subse- 

quent data, were discussed in an earlier chapter It is interesting to note 
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or hyperconsistency. that is he obtains data that are 

^mtype (1) L obtained data, his 

correctly consistent “ the°“cOTect” value and, therefore, can be 
data vary only negligibly about t accurate ex- 

only feteL Hlc^n provide us with the desired 

Ste of vaL with far fewer responses than can any other 

All other experimenters [( 2 ) to (7)1 ^ 

for the inaccuracy of types ( 2 ) ^ (3) ^ J t 

data will, in the long run, prefer (2) because his 

value. Between experimenters ( ) conclusions with fewer subjects, 

greater consistency permits “ to dra preferences 

Among biased experimenters [(4) to ^ ^ ,uc, a positive (net 

From die point of view * Jm a neg^ti- (net low) [(5) 

high) [(4) and (6)1 bias ^ reference for the consistent 

and (7)]. There may, however, be a s gn^ p^ expenraenter. 

[(4) and (5)1 over the *. ^fo.\l,c consistent experimenter, and 

Bias can be more quickly revent his collecting additional, 

that may be useful information. It may pr 

unusable data. . , „ost experimenters will show one 

Let us assume for the mom P ^cems possible to 

or another form of bias to a ,clue although the cost will be 

obtain an unbiased estimate o ctrical distribution of biases among 

greater. If we can assume a 7 ^ cf the data obtained by a number 
a population of experimenters, th subjects will be required, 

of^erimenters is likely «> M biased 

and more experimenters, and that « why experimenter 

experimenter are consistent IW;* cnf[typ (6) “d (7)]- We shmiM 
™u be lower than if they are crs of opposite biases, the total 

note that it we employ a set of »P=" „j.o toir experimenter was 
variance of subjects' tesponse , d.sre^ fttnbutable to the two types o 
will be quite inflated because iudividual difference vanance 

experimenters will be added to the nom ^cre to say 

among an individual “P"™“jp,c of “balancing biases” which was sug- 
later about the important pnncipi 
gestedbyMosteller (1944). 

B.«.V MISPONSB MAGNm.DK VS. MASKD «KKKN« 

in our definitions of “f^raCum measure of“ sects’ be- 

could be used to refer no y 
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A TYPOLOGY OF EXPERIMENTER 
OPERATING CHARACTERISTICS 

We have emphasized three major concepts dealmg with the data-ob- 
taimng characteristics of expenmenters effect, bias, and consistency We 
may consider these three vanables as dichotomous for the sake of sim- 
phcity, although recognizing that, m fact, they are continuous vanables 
The three “concepts” in all possible combinations permit the following 
seven-category typology of expenmenters’ operatmg charactenstics 

(1) I. Accurate 
II Inaccurate 

A Unbiased 

(2) 1 Consistent 

(3) 2 Inconsistent 
B Biased 

1 Consistent 

a net high 

(5) b net low 

2 Inconsistent 

(6) a net high 

(7) b net low 

illustrates each of the seven types of expenmenters, each 
° drawn two samples of N subjects In each cubicle or semi- 

^ ^ distributions of responses are shown in relation to the “cor- 
rcc v ue (indicated by the arrow), and the number corresponding to the 
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TABLE 17-2 


Unbiased Response Magnitude and Biased Inference 



1 

It 

III 

IV 


Experimental 

Control 

Sum 

Difference 


1.0 

1.0 

2.0 

0.0 


1.3 

0.9 

2.2 

0.4 


1.2 

0.8 

2.0 

0.4 


1.1 

0.7 

1.8 

0.4 

“Correct” 

1.2 

0.8 

2.0 

0.4 


Table 17-2, however, shows that although Ei was unbiased in response 
magnitude obtained (column III), he was biased in the inference permissi- 
ble from his experiment (column TV). He was the only experimenter not to 
obtain the “correct” mean difference of 0.4. In this example B, might have 
been biased even further in the direction opposite to that of the correct 
mean difference. That is, he might have obtained significantly higher values 
from the subjects in his control group than from the subjects in the experi- 
mental group. At the same time, his obtained response magnitude might 
have remained unbiased. 

Table 17-3 shows that our protagonist, E„ has obtained the same dif- 

TABLE 17-3 


Biased Response Magnitude and Unbiased Inference 


1 

II 

III 

IV 

Experimental 

Control 

Sum 

Difference 

1.7 

1.3 

3.0 

0.4 

1.3 

0.9 

2.2 

0.4 

1.2 

0.8 

2.0 

0.4 

1.1 

0.7 

1.8 

0.4 

1.2 

0.8 

2.0 

0.4 


“Correct" 
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havior but also to the difference between that measure and a comparison 
measure Therefore, the data distributions shown m Figure 17-1 may for 
the sake of generahty be viewed either as arrays of raw data obtained from 
homogeneously treated subjects or as arrays of difference scores arising, for 
example, from the differences between expenmental and control mampula- 
tions What we must consider now is the fact that an experimenter may be 
very biased in the raw data he obtains and yet be completely unbiased in the 
inferences his data allow him to make Put more generally, maccuracy in 
the order of magnitude of data obtained may be quite independent of the 
inaccuracy of the inferences to be drawn from the differences between data 
obtained from the groups to be compared We can illustrate this point best 
by restnetmg our discussion to the occurrence and nonoccurrence of only 
one type of inaccuracy e g , bias Tables 17-1, 17-2, 17-3, and 17-4 show 
the four possible situations 

1 Data magnitude unbiased, inference unbiased 

2 Data magnitude unbiased, mference biased 

3 Data magnitude biased, inference unbiased 

4 Data magmtude biased, inference biased 

In Table 17-1 we are interested m comparing Eg*s data with the “cor- 
rect values ’ as defined by the means of £s a b and c We see in this case 
that the responses £, obtained from his subjects are just like those obtained 
by the criterion experimenters In addition the difference between the data 
obtained from expenmental and control group subjects is identical when 
we compare £*’s value with the * correct value ” We conclude that Eg 
showed no bias in either response magnitude obtained (column III) or in 
ference permissible on the basis of obtained differences (column IV) 

TABLE 17—1 

Unbiased Response Mognitude and Unbiased In- 
ference 



“Correct" 


08 


04 
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XheGenendltyandAsse^entofE^erimenterEfieds 

' _ e o Tpnrescilts 3 dr3ID3tlC clioiCSl 

But let us say that a mean di J single experimenter’s 

improvement in the patient. nroccdure that, on balance of cost 

research, we might institute a surg example where we 

S'h^SSrrcMu Showing the slgnlhcance cl a dlherence 
but in showing its absolute magmtude. 

the practical problem of assessment 

our discussion ol the ass-ent 

largely theoretical. Now we " jha,, because o{ dilierences m 

have experimenters conductmg e p -joeedure, cannot reasonably be 
subiect sampUng, instrumentauon, an p ^55^55 the 

:?4ld irecSy to any other e^—^How^^ ,,perimenters7 The 
operating oharacterisncs-i.e., the acc^^oy ^ 

answer is simple enough— it ca experimenter as to his treatment 

experimenter may be due aa ra“o>> * ^ single experimenter cfn 

conditions. No experimental data d ^^ioeal unless repheated by 

be considered as anything mote than mg yp 

at least one other investigator. - ter to be accurate until the hKt 

We may assume any given a"Pa";;meement between the resvdts 

repUcation is carried out. If there IS ve^ dos gT ;^ expenmenter 

o?the replication and of *e if„ot confirmed either^B 

accuracy is not ‘ha'aadited, though f ^j^canUy opposite m direo- 
the resits tend to be quite different replications are earned out. 

tion we may ^nspend judgment d 

If the results are significantly PP jespect to each other. Our ® 
than ever that the results are hmsed ^ f gnd that after a senes of 

5n ls to demand further repheaUon.We^^^^^^^ 

replications our original ^‘udy and ‘he i„ the ounwl ama 

dismepant results, with aU distribution. Now P‘“ 

of what now begins to ‘ooh a ItdLd 

tice. ean conclude Cor more a^mam y .‘’T.mdTand 

yielding biased data-biased P j ;£ after our ongmal sti^dy an 

will constitute our correct repheauon “ 

earuer study as qm‘o ^/“bUed data but also to help us corr 
only to assess the accura y subiects, 

any inaccuracy of data. ., „pant the results from two o in gen- 

In general, the more isorepan parameters. And, g 

the morS subjects are needed to esta 
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ference between his expenmental and control subjects that was obtained by 
the cntenon expenmenters (column IV) However, the response magnitude 
he obtained was significantly greater than that obtained by the more “ac 
curate” experimenters (column III) If the purpose of the experiment was 
simply to establish that the subjects of the expenmental group would outper- 
form the subjects of the control group, our E* has not led us at all astray 
However, if Acre was, in addition to an interest in the experimental-control 
group difference, an mtnnsic interest in the actual values obtained, E^s 
data would have been very misleading 


TABLE 17-4 


Biased Response Magnitude and Biased Inference 



1 

II 

III 

IV 


Experimental 

Control 

Sum 

Difference 

Ex 

1 5 

1 5 

3 0 

00 

Ea 

1 3 

09 

22 

04 

Efc 

1 2 

08 

2 0 

04 

Ec 

1 1 

07 

1 8 

04 

"Correct” 

1 2 

08 

2 0 

04 


Table 17-4 shows that in this example our has obtained responses 
of significanUy greater magmtude than were obtained by the more ‘ ac- 
curate expenmenters (column III) In addition, he found no difference 
between the subjects of his experimental and control groups and was, with 
respect to the criterion experimenters, in biased error (column IV) With a 
given obtained response magnitude, our E, might have been biased into the 
opposi e irecUon with his control subjects outperforming his experimental 
subjects He might also have been biased if he had obtained, say, a mean 
K Ki would not worry at all if we simply 

*^1 IT ^he superiority of the expenmental over the 

f * owever, if we had some mtnnsic interest in the magnitude 

of the difference favoring the expenmental group, we would have been 
misled Suppose that our expenmental treatment in this case was a very 
cosUy surgical procedure, whereas our control treatment was an inexpensive 
medical procedure Let us say that a mean difference of 0 4 represents a 
stausucally significant but clinically trivia! improvement in patient comfort 
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Beplications and Their 

Assessment 


• «»«tflblished in science generally. 
The crucial role of replication is possibly random human 

-he undetected equipment ^ computation, or report are 

rrors of procedure, observation, record, g,^ 

mown weU enough to the Random “fluhe,” eommon to al 

jiTaen we add to the ^ f differences and the poss.bihty of 

sciences, the t,ct of 

systematic experimenter ‘ ‘j,! to the behavioral scientist. 

pLance of replication looms S" Clearly the same expenmen 

^ What shaU we mean by rep' c J a 

can never be repeated by a dtSarent I95I). At 

can never be repeated by ‘be „tc different over a 

the verv least, the subjects and the p different individuals and the 

serils’^f replications. The sublets - -ually d.^ dramatical.^ But o 

experimenter changes over “reo- ‘ can be no replication in th 

avoid the not very helpful ““o relative replications. 

behavioral sciences, we can p a ,^^,5 of su j , 

experiments on how close “'ey t ,^,1 expen 

peLenters, tasks, and situations We ca^ ^ expenmen . 

mentthatwedoso) m this section, 
of an experiment. 

the ^ 

inferential MODEL!. replications-those car- 
lo .he real world we may eoun. tw-o orts_^^^^^^P ^ ecsc of 

ried out and those reported. The latter. 
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eral, the more discrepant the results of two different experiments, the more 
repUcations of the entire study by different experimenters are required In 
view of the importance of replications to the conclusions we will drav/ 
about experimenters’ operating charactenstics, and ultimately about nature, 
we will focus our attention further on the problem of rephcation 
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some conventional level of 

experimental group Co^^ five differences, 

and by a similar amount m each case ® between the ex- 

they are very unlikely to have occurred "^^^ricaUy distributed 

perimental and control fndmons were m fa^, ymm ^ 
about zero « - 9.50. df = 4. p < ^i*hold publication of 

Type n errors can be increased by significance (see also, Mosteller & 

results not achieving a given level g 

Bush, 1954; Mosteller & Hamrnel, 19 3)^ 

In order to benefit properly P , jj o„iy as brief notes 

it is essential that these ^c rou ne y p from a umversity 

with fuller reports available from ^ yyir^out such 

library, or from the American phenomena in general— 

availabiUty our efforts to learn abo h 

and more specifically to the PO'"! ^ seriously hampered, 

effects of the experimenter-will cont t investigators concern 

It has often been lamented of late that t^ jgjyy As 

themselves with more or less pccc>“ P 5,atus. Who, then, on 

an enterprise, replication it “essary replications? McGuigan s 

anv large scale will provide us with enough expcri- 

(?9 3fd ta and woods’ (1961) there to be no 

meats carried out and reported by ^p c ^^^piete repUcates as 

hardships in subdividing these fod'cs m / y not be increased, 

there are investigators. The total ■"vestm'n^oUim 

but the generality of the -su ts ,o some extent, we may 
projects would help us assess ^P" ns a truly •‘.ndependem 

feel that such replicaUon is not q“'‘c ^ ^^nrent laboratory. The 
replication carried out by „nmre of replicators 

problem of the potentiaUy dependent 
bears further comment. 


CORRELATED REPLICATORS 




TO begin with, an investiga^whe 
e^ts have always been in “ oxpententers with different 

... 

Journal Ot Nasalh o ResaUs pUterM 
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the former and certainly not a random subsample The difference m number 
between replications earned out and those reported is some unknown dark 
figure — a figure that depends, to some extent at least, on our view of sta- 
tistical inference The “null-hypothesis decision procedure” (Rozeboom, 
1960), advocated by many statisticians, tends to estabhsh certain cntical 
p values as the defimtions of whether a difference has “truly” been ob- 
tained Now this might be nothmg more than a semantic convention if it 
were not for a tendency among authors and editors to prefer pubhcation of 
results with an associated p value less than some cntical point — usually 05 
or 01 ^ This tends to result in the publication of a biased sample of expen- 
ments (Bakan, 1965, McNemar, 1960, Smart, 1964, Sterling, 1959) It 
has usually been argued that pubhshed experiments are biased in the direc- 
tion of Type I errors in that record is only made of the “ 05 Hits” while the 
“ 06- 99 Misses” are kept off the market That may well be true However, 
It can be argued that Type II errors may also be increased by the adoption 
of cntical p values 

Suppose that a senes of experiments has been earned out, all making 
similar compansons between an experimental and a control condition 
None of the results obtained by the five expenmenters were statistically 
significant ” None are published, and the expenmenters may not even be 
aware of the existence of four rephcations of their work Table 18-1 gives 
the hypothetical results of the five studies Although even the combined 
(say, by Fisher’s method) probabihties of the five studies may not reach 

TABLE 18-1 


Hypothetical Results of Five Experiments 


Experiment Experimental 


1 85 

2 70 

3 90 

^ 95 

5 75 

Weons 0 3 


Control 

Difference 

P 

7 0 

+1 5 

30 

55 

+1 5 

30 

8 0 

+1 0 

30 

75 

+2 0 

30 

6 0 

+1 5 

.30 

6 8 

+1 5 



of infcrencrfB^kMirwes^Con” d'’l946 

there ore mvcholoeicallv ir I960 Wolf, 1961) Evidence that 

among established 'mves'^^igalom a^wSl m ’’ 

students has been presented rerenUvmos™, S I e'""”''™ <>' 

1964, Rosenthal 4 Gaito, 1964) ('•“anthal 4 Oaito, 1963, Beauchamp 4 May, 
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keplication assessment 

What we have had ‘o say about correlated 
for the assessment of replications, uc jj studied a given area 

(1) to help us make a general Mp us make a gen- 

of inquiry or a specific relationstap ” 6 ’ a whole, has to say 

eral statement of what the availa e ^ j worker who 

about the nature of the f=‘‘‘°“‘“P^tl1rticle (e g.! in the Psyche 
wants to summarize formally, ® ! ™jg,a,io„ship but any investigator 
cal Bulletin), what is known of ^ profit from 

•'“"^he basic unit is the single 

menter. Assuming a “perfectly ® . ^search question, and 

value of 1.00. This '^°'>‘‘‘/,r^"!“riate (as defined by the consensm 

standard sample size, N, ‘'’f PP control groups were employed, 
of coUeagues) experimental * yi ^ to the treatment group roem- 

and that the data collector was effectively mm information with 

b:rs5 of each subject. Now this experiment, but 

which to assign a numerical value to th ^ y ,^5 sort anyway, and 

the tact is that we are constantly mata gHg^ b, ^t least fair 

sometimes with even less _ y singiVstudies in formal and in- 

agreement on a ranking of the The really difficult step is he 

fo^rmal seminars on tesearch meth«.J interest at the 

assignment of a numenca va u . experimenter but of ‘be expen ■ 
moment is not in the *%ycontrol comparison in whi h we 

Thus, we could find the ^c investigator was pmnanly 

were interested regardless o Certain compansons « S 

terested in that particular , few sentences in a report by 

interest to a given worker are ^ fy interest in that comparison In 
an investigator who has only nn -ne^ to our purposes. I 

other words, the intent of ‘he '"vest g Similarly, nre not 

is the validity of the companson tha . draws from his corn- 

concerned with the “nn}"*'°‘' “Sjnatly in the®degree to which they denvc 

parison, for such conclusions very J ^ ^ B, it is tha inequnhty 
directly from the data. If an L of how it came about. J 
which concerns us, not h.s «P'“"““° ^levant to the question of replica 
planation may be important, but it is n 

tion as we are discussing it. jan be reached on the assc 

If we grant that some ,hat a repheauon 

the single experiment, we can tate E 
siwanllolhankFrcUMoslellcrforhun 
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kinds of people, expenmenters, are likely to obtain different data from their 
subjects — then we are forced to the conclusion that within any area of be 
havioral research the expenmenters come precorrelated by virtue of their 
common interests and any associated charactenstics Immediately, then, 
there is a hmit placed on the degree of independence we may expect from 
workers or replications in a common vineyard But for different areas of 
research interest, the degree of correlation or of similarity among its 
workers may be quite different Certainly we all know of workers m a com- 
mon area who obtain data quite opposite from that obtained by colleagues 
The actual degree of correlation, then, may not be very high It may, m 
fact, even be negative, as with investigators holding an area of interest in 
common but holding opposite expectancies about the results of any given 
expenment 

A common situation in which research is conducted nowadays is 
within the context of a team of researchers Sometimes these teams consist 


entirely of colleagues, often they are composed of one or more faculty 
members and one or more students at various stages of progress toward a 
Ph D Expenmenters within a single research group may reasonably be as- 
sumed to be even more highly mtercorrelated than any group of workers 
in the same area of interest who are not within the same research group 
And perhaps students in a research group are more likely than a faculty 
member in the research group to be more correlated with their major 
professor There are two reasons for this Iikehhood The first is a selection 
actor Students may select to work in a given area with a given investigator 
ecause of their perceived and/or actual similarity of interest and as- 
sociated characteristics Colleagues are less bkely to select a university, 
nmv. because of a faculty member at that 

rsi y e second reason why a student may be more correlated with 
rJ ™ght be IS a training factor A student 

hf«Jr,p ^ ^ ^ of his research experience under the direc- 

hK Another professor, though he collaborates with 

other nprfnn^’Ait^ trained m research elsewhere by an- 

seems^p-icnn w be exceptions, even frequent ones, it 

more con-plnt^H whole, to assume that student researchers are 

directlv to n 7 ° ^^^calors that we have been discussing refers 
n" K 'o “ -rrelafon of data 

subjects The issue of correlated 
Karl Pearson snol ® ■’S"' on= Over 60 years ago 

an nfluZ T.t l“<igments [suggest.ng] 

served atmosphere, which may work upon two ob 

thrnr^h? f™''". 261) PearLbeheved 

sShtr." '• I" — I ... pw- 



327 


Replications and Their Assessment 

17.60. If we wanted to, we kverorreptatedness. 

our score of 17.60 represents a y P ^ hardly representing 

S“S.SX; 

beginning and values over 10.00 “ to y ' P ; j weights arbitrarily 
Thf weighting system 

employed in our examples are svstem We can sum up some 

the considerations relevant to a 

of the major characteristics of the sconng y ^ 

». .» 

value accrues to the total statement of how weU studied 

The replication index yields as are consistent or 

a riven problem is, regardless of w P statement of how con- 

inconsistent. However, the index also ah in the 

fident we can be of the ^P“‘ ° , situation where some replicaUon re- 
same direction. In the not infr q scoring system separately to 

suits are in opposite directions, PP y^ direction and then again to those 
all those replications yielding ” direction. The difference between 

replications yielding results m th PP j ni r„hich result is better esta - 
the two scores obtained gives some suggested can help 

lished. It is entirely P“®‘‘’’® ‘'o pgse that^of ten expenments five hav 

clarify a set of opposite results. S pp ^^,5 of five studie 

found A > B and five have found A his studen^, 

was carried out by a sing e m ^ hy less correlated expenmen , 
whereas the other set was . here could be an overwhelming 

including some with opposite n;P=;“g, set of replications. This would 
superiorhy in the points e some reason for assigning a 

be especially true if, in ‘^Tn the set of studies conducted by 

lower score for the individual tephcaW h seems more 

the more correlated replicators. At 1 replicaUon mdex 

valuable to compare n°"‘radicto^ ^ studies a®"' 

than to simply say there are Potions where the pro studies and 

may, of course, still ‘hose on index scores, 

con studies each earn high 

The Generality Index ,.nhcations discussed were 

we have talked very -"“f “ ^ can'also be applied, however, to 

virtually “exact.” The index ofrepheau 
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of that experiment which obtains simitar results is maximally convincing 
if it is maximally separated from the first experiment along such dimen- 
sions as time, physical distance, personal attributes of the experimenters, 
experimenters* expectancy, and experimenters’ degree of personal contact 
with each other. The number of dimensions (n) that may prove useful in the 
future is not known at present, but we can restate our principle in geometric 
terms. The value of replications with similar results is maximized when the 
distance between replicates in the n-dimensional space is maximized. 


The Replication Index 

Now for a concrete example of how we might score a set of replicates 
to determine how much we know about a given relationship. An investi- 
gator conducts a sound study with only some minor imperfections of design or 
procedure. The mean rating assigned by a seminar of competent methodolo- 
^sts is .80. In a few months he replicates the study and his new score of .80 
is added to his old. Now we “know” 1.60’s worth. One of his students 
replicates, and though we have argued that students are likely to be corre- 
lated with their professors, the student is a different person. We multiply the 
student s replication value of .80 by 2 to weight the fact of lessened correla- 
Uon of replicates. The student’s points (1.60) are added to his professor’s 
(1.60) for a total of 3.20 points. 

Now, a colleague down the hall replicates the work, a friend, perhaps, 
Who may still not be regarded as uncorrelated but who was trained by other 
^ P f came to the same department for reasons other than working 

rniu colleague. Doing the study in a very similar way the 

study, but to credit his presumably lesser 
V ’’y 3- He has taught us 2.40’s worth. 
We sum lus points with those obtained until now and have 5.60. 

carried out in a different laboratory by an in- 

renlicaton! w original worker or his correlated 

?ifctd bv thit ^ven higher weight, e.g., 5. Con- 

to the Dreviniici ^ ^®pl*cation might give us 4.00 points to be added 

to the previously cumulated total of 5.60 ^ 

all had no rer^nn^f °**'^***^^* replicators have all found similar results, and 
posiUon would posLute iu« Thu ’o theoretical 

Furthermore, he^doesn-t know the 

the nreviniic original investigator personally, or any of 

Ws labo ITt haT’ “ “"8 “y -f ‘o top it all off, 

niiire ic , 1 .. * ° * o-w. The weighting of 10, which seems 

Hi he other r r 'O his expectancy, which is opposite 

to all the other rephcators’. We now have a cumulated replication vXe of 
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.V ta>h« .1.. .!• Sp1“ ■« ■» « >“ 

anecdote only as to the plausibihty psychological terms, such 

Such plausibihty, lu the final analysts, ~;“/^,l,fied®^workers m the 
as the degree of behef or be seen as a more formal 

area The weU-controUed ^ny anecdote, as a fnncUon of 

anecdote, mote or less ,, and how relevant it is to 

who “teUs” It, how well and carefnUy « « ^,,3 to the expen- 

the question under study If we can ass ^ -bcation or generahty index, 
menl and weight these 7oMh crndef anecdote The 

we ought to be able to *"„,^aUy Z some value lower than d 

“soundness” points assigne as is the formal expenment Arbitrarily, 

it were a mote systematic anecdo , anecdote for which no con- 

let ns assign a score of 1° "gtr^To find Lm ‘ This search 
trary anecdote can be found after h usefully pursued by en- 

forlgauve instances is ^ ^otkers whose tLoretical posi- 

hstmg the reminiscences or observatmns of wo 

tion would suggest contrary aa„cel each other out mere they 

side of a theoretical of additional evidence The weigM- 

do not, we have fairly powerful be as was desenbed for more 

mg of the soundness scores ^ repheated anecdotes as a function 

formal experiments more weig S g weights, then, mig ty 

of the noncorrelatedness of he f ““‘^^be same teller to "10” for a con- 
from “1” for a new consistent ^server whose theoretical onenta- 

sistent anecdote told by a very jn order to encourage mor 

tion would suggest a contrary anecdote ^ U,,se remarks 

systematic observauons and ^ ur even exclusive ^ 

mi favorable to a swing to “ecdote m ] anecdotes are not 

evidence, we can add the rauon or generahty index unto 

scored as greater than achieved a given level (e g , 

the score on that index ha .Learch 

score) on the basis of more formal research lesser elegance 

There are situations >“ «h.«cdmes 
are actually more valuable than by different 

research question that has bee ludex score has been ac 

such that a very respectable ,3 y.eld results quite 

Assume further that the differen “^"_;^;" 3 „p^pose that a fair nunib of 
with one another (e g , A > B) observation, 

less formal anecdotes, “’‘='“''‘"6 ^^, 05 , stent with each other bu 

nature, and field studies, are a s q f„niwl sort— anthro- 

spor .be situation "o^-^ 

assessing Ihc reliability of the 
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only approximate replications If we were interested in the effects of anxiety 
on intellectual performance, a more or less “exact” rephcation would require 
more or less identical procedures for arousing anxiety and measuring in- 
tellectual performance We could as well apply our index to not-so-exact 
“replications” in which different arousal procedures and different measures 
of intellectual functioning were employed (The less exact the replications, 
the more the individual study’s score for “soundness” may vary ) 

A higher score on the rephcation index for a given research question 
imphes greater generahty for the results, assuming these results to be fairly 
consistent Because of our special interest m the expenmenter, we have 
dealt pnmanly with the problem of interexpenmenter correlation in our 
discussion of the assessment of rephcation If we were interested in the 
more general problem of generahty, as we often are, we could readily ex- 
tend our index to include other, nonexpenmenter factors increasing the 
generality of our data Thus, m the example given earlier of the effect of 
anxiety on intellectual performance we might give more points on a gen- 
erahty index for a “replication” that employed different methods for arous- 
ing anxiety and for measuring intellectual performance If a sample of males 
were employed where females had been employed before, or grocery clerks 
where college students had been employed before, or animals where humans 
had been employed before, we would weight more heavily the contribution 
of the “rephcation” to the generahty index In effect, the generahty index can 
differ from the rephcation index only to the extent that the replications are 
only approximately similar experiments 


ANECDOTAL REPLICATION 

In order that we not be wasteful of information we must have a place 
rep ication index or generahty index for information derived from 
rAt.. ° t an formal experiments For an appropriate example we may 
fnrr^n.^^ ypothctical Study of the effect of anxiety on intellectual per- 
QArvAri ^ 'Oppose that the expenmenter in his role as educator has ob- 
instances in which students’ anxiety has lowered their 
nhcprv ormance Suppose further that our investigator has never 

DroiJtr 'nstance m which anxiety (of a given magnitude) led to m- 
« O'her pe^le had also made the same 
tioml eviHcnr f instances, we would have some addi- 

ncrfonmnrc c a between anxiety level and intellectual 

of,enT„ “ *= “““"y 

areue ihn tii ^ “nnotation On the other hand, however, we can 

“'i =l=g=«’t Circumstances of 

‘>"==doi to the more elegant 
anecdotes of the ethologist, the survey researcher, and finally the vanablc- 
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Much of this book has n^oTlh! of “s research, 

expectancy may be an umntende . to the question of what can 

This chapter and those W foUow ^menter’s expectancy. A 

be done to control the effects of the e p be tecogmzed as 

of strategies wiU be proposed. Some of th lo^ewhat paradoxically, 

dhect attempts to minimize to maximize these 

some of these strategies tbaUeek neither to m.m- 

effects. In this chapter we shall ' ^ae and “calibrate” experimenter 

mize nor to maximize but rather to *e 

expectancies. In preceding c p , experimenters rather 

crying from the Employment o 30 „.e of these advantages 

moreusualsingledatacollector.Inth.se p 

will be discussed in more detail. collectors is already a 

The employment of samples of date to the 

practice in survey research (Hymi^n et p„^aps thousands - 

logistic problem of trying to obtain p p^ctice of sampl. g 

even millions, of respondents In part . “tn-a^bTs 

data collectors is part of a aelf-eons«ou 6 ^ 1 

fluence of the data collector ‘"f ^search (e.g., laboratory exper^_ 

1946) . In other kinds of psy<= ^^ted is low enough for a a'“g P 
ments) , the number of *“^1®''*® ^be necessity for employing P 
menter to collect aU the data oaa>^^The •. J 

experimenters in these cases. s not lo^st. ‘,n se“eEs 

Tt was stated earUer that in pnncip repUcaOon to serve as 

menter’s accuracy at all v;itl'°"^j;'^3 accuracy. And as °“r 
the reference point for the are in an increasingly go 

experimenters increases m si collectors tor 

iTlie pracica. Pf.'=- f."torTnd has hcca found no. a. 
research was discussed m 
mountable. 
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sistent with the results of the more formal laboratory experiments, such that 
A < B always In such a case it may be that the formal experiments as a set 
are biased with respect to more “real-hfehke” situations This sort of 
bias could occur even though the experimenters were completely unbiased 
m the sense in which we have used that term It could well be that the very 


laboratory nature of the cxpenmenter-subject interaction systematically so 
changes the situation that the more usual extraexpenmental response is 
qmte reversed This effect of the expenmental situation on subjects’ re- 
sponses has been frequently discussed and even labeled (e g , experimental 
back-action or backlash effect) The demand characteristics of the experi- 
mental situation (Ome, 1962), although varying from experiment to ex- 


periment, may have, for a given type of study, such communahty that the 
results of even an entire set of expenments may be quite biased For this 
reason, and because of other special characteristics of the laboratory ex- 
penmental situaUon (Riecken, 1954, Riecken, 1962), there may be oc- 
casions on which anecdotes, less formal than the experiment, may be more 
valuable than additional laboratory expenments One view of the more in- 
formal source of evidence that emerges in part from what we have said is 
that there are phases in systematic inquiry in which more anecdotal evidence 
IS more hkely to have special relevance Before a program of expenments is 
undertaken, informal evidence seems useful in guiding the direction of, or 
even m justifying the very existence of, the expenmental progmni Then 
later, at the completion of the program, a systematic search for (preferably 
new) anecdotal evidence seems indicated to reassure us that the generd 
findings of the more formal research program are consistent with more 
nearly everyday expenence 

about the formal expenmental situation 
oirH A * construed that the laboratory setting comes somehow to be re- 

at the same time, it is 
less common than the word 
from^hp^-ih*"^/^^ (Mills, 1962) Whether we can reasonably generahze 
«eH t f ^ “everyday” hfe, then, is an empirical qu^fion to be 

answered ^ serving both, rather than a philosophical question to be 

answered on any a pnon grounds 5 i' l' 4 



to the often asked question of whether we 
aDimal behavior to human behavior 
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data collector for a given f j^erTi be situations in which 

subject per condition. On the other hand, there rnay be 

the utility of the procedure "“"f„Vestimate of individual 

back to this procedure is tot it prow^_^^ 

differences among subjects. Th PTnerimenters. This may not be too 

is confounded with the variation S P gsti^jate of the effect due to 
serious, however. If we can e sa differences among experi- 

the treatment condition and within cells mean square. Even if 

menters, we may be willing to a^single^ondition we 

each experimenter contacts °"ly “ a to^gh we could get no 

could still evaluate the effects «« ‘he „p,l,enters. 

estimate of the variation among either subjects P 


Increasing Generalizability 


reasing Generaiizauluijr 

If there were no effect of “P°",*“we woul^stiU benefit greatly 

any form of experimenter ®’‘P“‘®“7exoerimenters. As Brunswik ( 1956 ) 
from the employment of samples « ^ ^ gjeatly increase the 

and Hammond ( 1954 ) have Pf "‘"„f^iSrences^in appearance and 
generaUty of our research results. Bwau ^^bjects, 

behavior, different “peri'n=“‘«‘* tjje experimental situation as 

thereby changing to a greater or lesser degree P 

the subject confronts It. has been employed, we have no way 

y^en only a «°S'^^«P“"ouTd have made if a different expen- 
of knowing how much differenc research arc then confoun 

menter had been employed. The ® menter. We would have httie 

with the stimulus value of ‘h® Pfh=™ P ^ subsequent experiment em- 
confidence in a prediction of ‘h= ediction that the result would 

ploying a different experimenter „ we employ the better, to 

probably be different. The more "'"^bnenter helps a great deal. We 
even the modest addition of » »‘"g -be result of a subsequent “P“to" 
not only would be able to predict that the ms ^.p.rimenters’ results bu 
would fall somewhere near the m deviation from this va 

would be able to say two experimenters we can make a 

likely. In other words, with f^/^,„‘7rinciple. of course this hue of 

statement of experimenter . ^re sampled randomly, 

reasoning holds only when «P="™""‘feu,omated data-collecuon systems 

A Uttle later, we shall speak of avoiding differentml 

(ADCS) and shall stress their (hat any ADCS has ‘‘s ° 

treatment of subjects. Here it mu ^ oan then regard any g 

special stimulus value (McGu.gan, 1963) 
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position to assess not only the expenmenter’s accuracy but his bias and con- 
sistency as well 


Subdividing Experiments 

With the sample size of subjects fixed, the larger the sample of ex- 
perimenters, the smaller the subsample of subjects each data collector must 
contact Subdivision of the expenment among several expenmenters may in 
Itself serve to reduce the potential biasing effects of the experimenter 


Learning to bias. We have suggested that expenmenter bias may be 
a learned phenomenon, and that within a given expenment the expenmenter 
may learn from the subjects’ response how to influence subjects uninten 
tionally This learning process takes time, and with fewer subjects from 
whom to learn the unintentional communication system there may be less 
learning to bias Even if the interpretation of bias as a learned phenomenon 
were in error, the basic evidence that bias increases as a function of the 
number of subjects contacted by each expenmenter should encourage the 
use of more expenmenters and fewer subjects per expenmenter 


Maintaining bbndness. A second advantage gained when each experi- 
menter contacts fewer subjects is related particularly to the method of blind 
contact With subjects In discussing that method m a subsequent chapter 
It will be suggested that if enough subjects were contacted, the expenmenter 
nught unintentionally “crack the code” and learn which subjects are mem- 
ers 0 w ich experimental group and/or the nature of the experimental 
treatment subjects had received The fewer subjects each expenmenter 
contacts, the less chance of an unwitting breakdown of the bhnd procedure 


hv ^ advantage of having fewer subjects contacted 

imF thnf ^ “psychological” advantage, denves from the find- 

With mrtrJ ^ returns may have a biasing effect upon subsequent data 
autrVIv if - ^be entire expenment can be completed more 
bv available for the simultaneous collection of data 

IS less need '^*th all the results of a study “nearly in” there 

and henrf 1 ^ i! investigator to get a glimpse of the early returns 

and hence less chance for the operauon ot the b.as.ng effects of Ihese re- 

cntirew'the'effp '“"'“'hng fewer subjects would, in fact, eliminate 

eSm If eneh° '*•= biasing behavior ot the data 

trea 2m f ™ly a single subject in each 

lla or ' ’k of “urse, innuence the 

data Iherer 2 ir"^* same condition Where there arc no later 

data there can be no cllect of early data returns 
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li.rv he .^elected for personality characteristics associated ™th people 
a corollary, he selecteo lor p . , .cj-nce and having certam ont- 

for our purposes. experimenters to 

There is, however, a ‘m less mg y ^ 

collect data for serious scientific pu^ose - 35 ,;^eU. As this 

students are collecting behavior .n,niovmenfof less fully professional 
ttend continues and accelerates, “-^^TP'^^^^p^^Ltative of the “real 
experimenters will become mot at all far-fetched to draw 

xXld” of data coUection. At the behavioral sciences and 

samples of advanced undergra mipht expect from advanced under- 

generahze from their results to what t “ „„t be sacrificing 

graduate research assistants. It seems ‘h»- of less than 
Too much ecological vaUdity, after all, by employmg P 

fully professional data collectors^ p,„prinienters to experiments gets around 
The random assignment of p hypotheses. Expen- 

the potential problems of seU-selechon oUecting data relevant to a 

menlrs, natuU enough, Vrivln^^swer. H the investi- 

question to which they are P 3h^t the outcome, empl^s a 

gator, though he may have an e p jhe data from the effects 

random sample of data collectors, ejpecially true if the sampling of 
of his own expectancy. "P*® of,he cOTtrol strategies desmhed 

experimenters were combined wi personality characteristics or 

in subsequent chapters. If mdeed choice of rese^h 

other attributes ““ri^enter are likely to show a certam 

question, the data coUected by The random assignment of 

amount of error, though not 3„“3, problem of self-selection for 

experimenters also gets us around this potenu P 
correlated attributes. 


CanceUation of Biases ,^3^ 

Simply selecting our “ 3„des they do have, however 

they will have no expectancies. The P ^ have not tne 

are more likely to be heterogeneous ^d r,ho have m 

to select experimenters very “"'^^^^Xesemch. The more heterogeneous 
past collected data within a chance that the effects of expec an 

the expectancies, the greater * 

will, at least partially, (1944) for the 

canceling of biases is Aat X ^ jPat principle does not e 
vey research interviewer, 
that of the laboratory expenmenter. 
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ADCS with Its particular stimulus settings as just another expenmenter, 
although a very “standardized” one To increase the generality of the ob- 
tained results, therefore, we must sample a variety of ADCS’s or at least a 
variety of settings of a single ADCS 

The employment of samples of data collectors, necessitated by theu 
individual differences, may be viewed as a boon to, rather than the price 
of, behavioral research Built-in replications, although they bnng with them 
the data collector as a source of variance (which can be measured and 
handled statistically), also bnng a greater robustness to our research find 
mgs 2 

From the point of view now, not so much of generality but of the con- 
trol of expenmenter expectancy effects, there are three conditions involving 
experimenter sampling which will be discussed in turn In the first of these 
conditions, the sampled expenmenters’ expectancies are unknown and inde- 
terminable In the second of these conditions, experimenters’ expectancies 
are known before the sampling In the third condition, expenmenters’ ex- 
pectancies are known only after the sampling has occurred 


expectancies unknown 

Population Characteristics 

There may be expenments m which we decide to employ a sample of 
expenmenters but in which we have no way of assessing the experimenters’ 
expectancies We may draw such a sample from a variety of populations 
menng m the number of restrictions imposed Perhaps the least restnctive 
population of potential expenmenters would be all those who are physically 
nnniiTf ^ Capable of serving as experimenters If we choose such a 
data perhaps the greatest degree of generalizability of our 

val.H.fv representativeness of the real world or ecological 

most validity IS sacrificed, however, only in the sense that 

from less broadVdefild populations 

xsmicaUv^ran^wr^F^^^ff ^ experiment are not simply organ- 

basis of an !nt ? ecting the data They are further selected on the 
res LeJ on rnn'tV" ^ -Merest m the particular 

Tn tre Lrnr,^ to answer They may be further selected 

on the basis of the expectancy they hold about the outcome They may. as 

increased geSerahS^deL^^"fr^m 2d 

procedural variations But ft would L expenmenters and their associated 

traditional workers in the fieW of that more classic or 

R A Fisher (1947) for disagree with Brunswik 

explicitly associated with different “1 Procedural variation not 

«u» cuiieciors makes the same point 
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r.£=”-'.:r5 

menters expecting poor performanc aiternate*^£onn retest is lower 

average the children’s performance admimstered test We can see 

by some amount than It was on the ong y^^^^ jj,a 

that this bias cannot be canceled ..„cting good performance cannot 
youngsters tested by tStest Regardless of any expen- 

perform any better than they i ,._?,o„al influence, organismic hmits 

menter characteristics facilitating aiean of 

permit no biasing in the directo direction by the in- 
cur obtained retest data has equivalent and opposite bias In 

abihty of half the experimenters to exe« q ^ 

this case, the retest f if the 

direction Interestingly enoug , cnbiects’ performance equivalently 

performance had been able to bias ^f^nnance obtained, 

there would have been no bias 8 oosttest would have been even 

but the correlation between the same expectancy effect, the 

further lowered If all expenmen maximally biased, but the retest 

grand mean performance would have bee ^^^ames, as 

rehabihty would not, of course, h expectancy exercises the same 

we have here, that any ”„°"ter in that same expectancy con- 

magnitude of effect as any other expenmenter 

dition cvinmetncal effects of bias has been re 

An interesung example of » V analysis of an opinion sur- 

ported by Stember and Hyman (1^ ^ ^ a common opinion tended 

vey they found that interviewers *; ”^n„<jents to be found with that 

to report data that inflated the "“"f t«po 

same^pinion Interviewers ho'^g ,he category of their own 

inflated the “don’t know” ‘id as modehng bias, we ngnm see 

opimon In this case, which we can g response was inflawd 

failure of the cancellation of bias T 8 One interpretaUon of this 

in the more “commonly held °P'";”" “^cy bias may have been oper- 
unexpected finding proposes that a P , J ^nown what the maior y 

ating simultaneously Thus, if it ■; 8nn« a heavy majority, then 

opu?ionis,andifit.sknownalso th^‘h«^ obtain major y 

interviewers may have the «P“tanj^ expectancy by itself may inflate 
opinions at least most of t e 

the expected majority opinion catego^ ^ y opinion, the r 

For interviewers whose own opimon ,„flam 

modeling bias may act in “njuncuon t ,jrr, ,„monty opinion- 

themajLty opinion category even more H 
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If we can hope for a canceling of expectancy bias, we can also hope 
for a canceling of modeling biases But where the experimenters’ expect- 
ancies and their own task performances are unknown, we can only hope 
for such a cancellation And even if this information were available we 
could not count on a cancellation The various expectancies represented in 
our sample may be held with different intensities, resulting in different 
magnitudes of expectancy effect Or particular expectancies may be corre- 
lated with personality charactenstics or other attributes that are themselves 
associated with the degree of unintended influence exerted by the expen- 
menter An example may be helpful 

Suppose we want only to standardize a set of photographs such as those 
we have often used as to the degree of success or failure reflected by the 
persons pictured We select at random 20 experimenters, all enrolled in a 
course in expenmental psychology For the sake of simplicity let there be 
only two expectancies among experimenters ( 1 ) that the photos will be 
rated as successful and (2) that they will be rated as unsuccessful Let us 
suppose further that the “true” mean value of the photos is at the exact 
point of indifference If ten of our experimenters expect success ratings and 
ten expect failure ratings, and the magnitudes of their expectancy effects 
are equal, we obtain a grand mean rating that is quite unbiased That situa- 
tion IS the one we hope for 

But now suppose that the ten experimenters who expect to obtain 
success ratings differ from the experimenters expecting failure ratings in 
eing more self-confident, more professional m manner, more businesslike, 
and more expressive-voiced These are the experimenters, we have already 
seen, who are more hkely to influence their subjects m the expected direc- 
hon he ten experimenters expecting failure ratings do not equitably in- 
uence t eir subjects m the opposite direction Their mean obtained rating 
pomt of indifference, and they cannot serve to cancel 
the biasing effects of our more influential success-expecters The grand mean 
ra ing o tamed will be biased in the “success” direction Troublesome as 
nirtt may be, we should note that it is still better than having em- 


pl^ed only a few self-selected, success-expecting experimenters In this 
parucular example we would have been best served by selecting only those 
experimenters who could not implement their expectancy But, of course, 

readSyavaTabk ™ 

in cancellation of bias may also fail for reasons residing 

^ '"■ght mvolve a “ceiling effect” 

Suppose a large number of children have been tested on a group adminis- 
tered form of a new perceptual motor task The testing was done under 
ose con * mns o administration maximizing their performance as the 
rignator of the task intended Now suppose that to establish the reliability 
of the task performance all the children are retested, this time with an indi- 
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we must know what weU known before 

error) are like. In some cases th eexpeetenc^^ 

sampling, and m other cases, g situation in which 

rpelXtxp"s':^^^^ icnown before the sampUng occurs. 

expectancies known before sampling 

I„ all the sciences there are r be'r^at 

are so well known or so east y their research. Acadenuc 

on the nature of their exoeriment in order to demonstrate that 

scientist A designs and scientist B may design and conduct 

his expectancy is warranted. , his expectancy that scientist As 

an experiment in order to de^^ controversy at tts 

expectancy is unwarranted, inis, 

best-taken into the laboratory for t^_ may design 

If they are in the bahavioral fences conclusions. Each 

and conduct quite different a ^ct any unintended biasing effect 

may obtain the expected results whether or no y ^^ hey 

cccLed, and feel his own P°f'°";°"hU nothing to say about the oc- 
conducted different expedients, w ca cne camp are 

currence of expectancy aHec «. Swn ^ jhe other camps ex- 

likely to attempt a mote or less P jjh the original data, we a 

periLnt. If they obtain data “/g effects in either study was 

somewhat reassured that the ro P can we attnbute the 

minimal. But if they obtain ao"dW „se geographic and tem- 

ference to expectancy aSacts Paobf 'y ^ ,„sibutes all covaned 
poral factors, subject population ano P 
with the possible expectancy e ec . 

CoUaborative Disagreement 

For the resolution of ‘haa^^^^^Wnt and disagreeing scienUste, 

to engage the interest of two o efforts more a®aiently. A 

it seems worthwhile to a°°5tr“ ™mably collaborate in the P™duction of a 
sign stage the opponents might profitably^ ^ may 
research plan which by agree collection, too, the opp 

ference of opinion. At the stage of data P'°''’f of llc^ 

collaborate either in person “ ^ ” using a common pool of subjects 

scientists. Conducted at the same place ^^pUcates prov de 

and the same procedures, *e *wo ( ^.„„c„ce either to 

simUar results. If they do not, we may 
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holding interviewers have a modehng bias which runs counter to their ex- 
pectancy and serves in fact to cancel it Left with neither an unopposed 
modehng bias nor unopposed expectancy, the neutral “don’t know” category 
IS inflated Whether this is what happened m the Stember and Hyman study 
or not cannot be easily determined But this analysis does illustrate the 
possibihty that opposing biases within the same expenmenter may cancel 
each other and that consonant biases may reinforce each other It should be 
mentioned that the bias m this study could have been one of interpretation 
or codmg rather than a bias affecting the subjects* response, but this does 
not alter the relevance of the illustration We have already suggested that 
the experimenter’s attitude toward the results of his research may affect 
his observation, recording, computauon, and interpretation as well as his 
subjects’ responses 

From all that has been said it seems clear that we cannot depend on 
the complete cancellation of biases in a sample of experimenters But the 
argument for sampling experimenters is still strong At least by samphng 
experimenters we have the possibility of cancellation of biases, whereas 
if we use only a single experimenter we can be absolutely certain that no 
cancellation of bias is possible 


Homogeneity of Results 


Employing samples of experimenters will often provide us with con- 
siderable reassurance If all of a sample of expenmenters obtain similar 
data we will not err very often if we assume that no bias has occurred and 
t at, m fact, no effects whatever associated with the experimenter have 
occurred On these occasions we have good reason for arguing that only one 
experimenter would have been required But, obviously, there is no way of 
sample heartening fact without having first employed experimenter 


if th ^ o^ogeneity of obtained results should not be so reassunng to us 
inM experimenters has been very restnctive If our sample 

tn collectors holding one expectancy regarding the data 

<iplppfpH occur if we selected only experimenters who had 

penennc investigation, our results would be homo- 

^ncino ,n A homogeneity of obtained results is con- 

ernpri^np proportiou to the heterogeneity of the expenmenters’ 

expectancies and other expenmenter attributes 

menterc discussed the advantages of samphng experi- 

tlndpr th expectancies are unknown and indeterminable 

pent hll. g^^^tly m terms of the increased 

hpct h-inhn-? ^1 controls for expectancy effects are at 

tip-iiiv th * F correction formulas can be wntten to control statis 
Ucally the effects of expenmenter expectancies To write such conecuons 
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Another ddficulty of “committee 

pectancy effects is that it is hkely to invo v y collectors it be- 

ment among the data collected by different investigators 

expectancies determined after sampling 

Established investigators “s W have W lum elsewhere for 

opinion are in sufficiently shor supp y experimenters are to be em- 

4er samples of data collectors « ““^^^regarding the outcome 

determined so that modeUng effects m y suspected of 

addition, other expenmenter attnb ,l,en controlled Tbe 

affecting, subjects’ responses ™y ^ attributes are easy to de- 

expenmenter’s own performa ^ J^xpenmenters may be asked to 

termine As part of the fining pr^cdure^ follow while 

serve as subjects They learn the p performance Other 

at the same time giving ^ be determined by direct observa- 

expenmenter attnbutes, if re * aee), by direct questioning (eg, 

tion (e g , sex), from public ^ ^ (e g , intelligence) Some of 

rehgion), or by means jbg determination of expenmenters 

these same methods may b more detail 

expectancies, which we now discuss in 

Determination of Expectancies ^ employ a fairly 

Inexperienced eM>ori“'"'®”-“rwthafwe can” obtain very highly 
large sample of experimenters it is less hkely 

experimenter would be "be B and C J ^^'IJ^'dSnbcd m 

opponent would be contactinE ^ j design wouM ^ „[ employing op 

venous possible ““'“-T” uney conuol groups The be 'C °PC o ' P^^y 
the ehapter dealing with „f eoursc tbn «me “ ^ we find the 

positely expecting “ .rdilterence is that m 

expectancy control groups ^ ,he latter case expenmenter vanable 

expenmenters expectancy Moectancy or of some ot -ropcrly regard it as 
Mf the drlnnuination of ““Le .n'’"”"'' 

were made after Ihc ”P'lj^ j collection ilself "'’P''* „ (e g birth orrler) other 
an independent ™f(e g . nnxiety) but not all (cg^^ expenmenter van 

™mrS.cs such PO— VXreS 
ables useless as a means of controlling 
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effects of the diffenng expectancies or to expenmenter vanables correlated 
with the diffenng expectancies 

Such collaboration of disagreeing scientists has taken place Dispro 
portionately often this “committee approach” to the resolution of scientific 
controversy has been applied to controversies involving either “borderline 
areas” of science or areas having major economic or social implications 
Such an approach has been suggested for the investigation of parapsycho- 
logical phenomena, for alleged cancer cures, and for study of the effects of 
smoking on the hkelihood of developing cancer 

In such cases even the scientific layman can readily infer the scientific 
“antagonist’s” expectancies or at least some potential sources of such ex- 
pectancies When the press described the distinguished panel of scientific 
“judges” prepanng the United States Public Health Service report on the 
effects of smoking, it carefully noted for each member whether he was or 
was not himself a smoker Laymen (and some scientists) were forced to 
reject the hypothesis that the committee’s evaluation might have been biased 
by their expectancies or preferences by noting that its conclusions were un- 
correlated with their own smoking habits On the other hand, when the 
press reported the dissenting view of scientists employed by the tobacco 
industry, the report was clearly if implicitly wntten in the tone of “Well, 
what else would you expect’’’ It is, of course, not necessanly true that the 
expectancy of an industry-employed scientist is due to economic factors 
The expectancy may have preceded the employment and indeed may have 
een a factor in the particular employment sought But the source of the 
relevant to a consideration of ethical rather than 
of an expectancy may be quite irrelevant to 
ita obtained or upon interpretations of data 
that the “committee approach” to scientific 
o areas of great interest to the general pubhc 
generally appealing issues to which most 
deserve equal effort to mimmize sources of 


-wvoiiuw i^ucsuons me origin 
the degree o£ its eflect upon di 
It seems very reasonable 
investigation has been applied I 
But the more technical, less 
scientists direct their attention 
error 


with T when established scientists collaborate 

contacts or •I'o cflects of their expectancy In their 

backward In contacts with subjects they may bend over 

over^aekv^^rrs This ‘bending 

investmatr In’nh, f ‘ “ earher chapter, may lead each 

DOthesis For this fttased m the direction of his opponents’ hy- 

the samnlino of greater control of expectancy effects, 

with the^nm I With known expectancies is best combined 

with the control techniques to be descnbed in subsequent chapters < 


can prI?°edTnTe amplr cSe 'm'thetaile c°llabcrating mvestigatofs 

experiment ,n the lemfinnlogv .n.i\T:„7nr.Lr cra^pler“Srr 
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occur. These can then be “corrected” by such statistical methods as partial 
correlation or analysis of covariance. These same corrections can be ap- 
plied if significant and/or large correlations are obtained between the results 
of the experiment and experimenters’ own task performance or other 
attributes. 
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experienced data collectors More inexperienced experimenters such as ad- 
vanced undergraduates may have no particular expectancy about the result 
of a given expenraent They may not know enough about the area to have 
developed an expectancy For these experimenters we can describe the 
experiment in detail and ask them to make a “guess” about how subjects 
will respond This guess then may serve as the expectancy statement The 
form of the guess may vary from an open-ended verbal or wntten statement, 
through a ranbng of alternatives to an absolute rating of the several alterna- 
tives If there are several possible expectancies or several degrees of one 
expectancy, we may want to assign to the open-ended statement some nu- 
merical value This can be accomphshed by having judges rank or rate 
these statements on the direction and magnitude of the imphed expectancy 
Ranbng or absolute rating of alternatives by experimenters will give us 
numencal values of the expectancy in a more direct way and may, therefore, 
be preferred 


Experienced experimenters. If our sample of expenmenters is com- 
posed of more sopbsticated data collectors there is a greater likehhood 
that expectancies are better developed We may still use the methods 
sketched out for inexpenenced experimenters, but we have other alterna- 
tives We may, for example, ask the expenmenters' colleagues to rate their 
expectancies based on their knowledge of the experimenters’ theoretical 
onentations Or, we can make such judgments ourselves based on reading 
the reports published by our expenmenters or even perhaps their term 
papers The reliabibty of these judgments made of an expenmenter’s ex- 
pectancy by his colleagues or from his wntten documents must, of course, 
be checked 


With sophisticated expenmenters who are already familiar with the 
research literature, we can ask them to wnte out or tell us “what previous 
shown should be the outcome of the experiment and “how 
e e researc was done ’ This “state of the art” paper or monologue can 
be quantitatively judged for the expectancy ,t seems to imply 


Con-ecfing for Expectancy Effect 

either a expectancies distributed only dichotomously, 

of At other times we will have an order- 

these rasp terms of either ranks or absolute values In any of 

thlr the experimenters with 

p les f the correlation is both trivial in magmtude and insig- 
n ^ah ft reassured that expectLy effects were 

p baby not operating If the correlation, however, is either large nu- 
mencally or significant statistically, we conclude that expectancy effects did 
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„„ gi.. ” r..d° ■S 

but there are Uterally ° these behaviors have oc- 

described. Generally it is no desctibing them if we Icnew of 

curred. We have no ‘“^eT^erimenter behaviors do 

them. Yet, for all this, these in earlier chapters, 

affect the results of the experimen , scientific 

These behaviors consbtute perh p P “behind closed doors,” as 

enterprise. They are less Jor g i^suffidently studied 

Reck 119571 has reminded us, than for Having 

and ruled out as sources of ““"“^J^aWng the data collection process 
We stand to learn a great deal f g of the expen- 

more public because it will scientists the opportunity of see- 

ment mote precisely. We S' . in the case of out calculations, 
ing what the experiment was so tha , j with 

our reasoning, and our ,he experimental manipulaUon, 

us. They should be free to ‘'“‘f^J^tSTmplemented. They should be 
which we claim, was or was not ' ^or actually ran according to 

free to decide whether our programmed behavi 

the program. „i.vant variables we were not now teport- 

Of course, if we research reports. Since we 

iug, we could simply "^0 proce^ to a wide angle look so 

do not, we must open da a coll U P reported, 

that we can learn what vanables must in 

Observation Methods Brnetimenters’ 

A variety of methods are ''’*“^“„'’’^ese ^ include the use 

behavior during the data P'^„icci observers. Each method and 

of various kinds of human and ^ advantages and d.sad- 

eaeh combination of methods has its ,^htch method 

vantages, which each investigator must weig 

to employ. . 

Subjects as observers. EmUer in Ws after the 

subjects themselves may be ampl°y«> “ ” asked to describe Ins expen- 
experiment is over for the subjec ^ , d a series of rating scaks 

menter’s behavior. We ° “,^_bu^t open-ended questions, a^ec- 

,0 help the subject with M „ could be employed as ^ k 

five cLknsts.Q sorts, and otherj^^^^^^^^^^ the advantage 

More qualitative, less 
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In the last chapter some techniques for the control of experimenter 
expectancy effects were suggested which depended on the determination of 
experimenter behavior, expectancy, and other attributes before the data 
collection process began In this chapter we shall consider some related 
controls which, however, depend on the determination of expenmenter be- 
havior, expectancy, and other attributes dunng and after the data collection 
process 


OBSERVATION OF EXPERIMENTER BEHAVIOR 
The Public Nature of Science 

nature of the scientific process is one of its defining char- 
ni scientists is determined in part by our intent that 

as meii ° scientists is intended to be learned 

Oiir scientist with appropriate background and interests 

to eTr„ ' I" We 'ry to make public the reasomng 

were and Tinw "^e conducted the research, what the results 

the reasonmo in^t these results We expect scienbsts to differ in 

data TtishpLi ^ experiment and in the interpretation of the 

scientists that an^ ° * ^ public nature of the reasoning and interpretation of 
of any other disagree with the reasoning and interpretations 

civen With*'an° We must simply accept them as 

folkctm^ th description of the circumstances of their 

Ltncer; ‘ But particularly m the behavioral 

descnoLn nf “ “ "npiissible We Lnot even give a 

b rausi we d T: '"1"'°^^ «'evant\ariables affecting onr results, 
because we don't know what they are In psychological expenments we 
344 
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^neuter's behavior. The methods of mafdng the observations may be as 
described in the case of subjects -as o se experiment; (2) ob- 

These expert observer may ( ) too dissimilar from 

serve through a one-way windo ^subjects” themselves. In this 

the subjects of the expenment (3) serve “objectivity” 

last case they might, unlike real su J ’ ^^ture of their training,, 

in interaction with the ,1,0 modalities in which the 

while retaining the greatest possible acc ^^^otory, 

experimenter can be said to behave le.g, 

tactual). rt sits in on the experiment, the expenirienter 

Obviously, if the “P^Vv, „ «tter his behavior in the expenment 
knows he is being observed. T ^ “natural” behavior would be tike, 

so that we can no longer ^,^00, the experimenter’s knowledge 

Observation of experimenter e observation or by the expert’s serv- 

may then be necessary either by ^^n of the propriety of decep- 

ing as subject. This, of course, more fully in the chapter 

tion for scientific purposes, a qu established by carefu 

describing expectancy | P,,' ji„ercntly when they believe then^- 

research that experimenters beha o ^ conscience eliminate the 

selves to be observed, we could m go^ sc*en 
method of covert observation, a method 

Representative observers. 

havior in different ways. “J . P , performances, we could argue 

experimenters’ behavior on ‘heir s^)“« P,^ 1,^ ,ike the subjects of the 
that the observers of the j„m the same poP“'“‘‘°'',„^'°” 

experimenters. Observers can b= dm ‘ bem 

which subjects ate drawn m .P , which their peer 6™“P ™ 
same aspects of experimenter behaw ,.^^pmsentative observers couW 

the subjects, were responsive^ Th 1 h,;, thel 

be asked to function in the smn observe, but they 

Ta^yX r:dTrr^-nt aspects of the experimenters 

Other populations of 

include colleagues of the ^ eLlize'd groups that might be 

colleagues, randomly selected g P experimenter behavi ^ . 

particularly sensitive to certain P physical education teachers, p 
actors, speech teachers, especially sensitive to verbal, motor, 

tographers and caricaturis s y 

and postural behavior, respect, y- „pcrimental 

Mechanical “ohservers.” During- „ „„y behavior 

interaction, the experimenter s behavior 
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that they may suggest additional categories of expenmenter behavior which 
may prove to be related to unintended sources of variance in the results of 
the research For some purposes of control, such qualitative descriptions 
may have to be quantified and although it is generally possible to do so, it 
IS not necessanly a convenient or easy matter Numbered rating scales have 
the advantage of being easy to work with but presuppose that we have some 
pnor information, or at least guesses, about the relevant categories Perhaps 
the most useful method of making observations is to combine the quantita- 
tive (e g , rating scale) and qualitative (e g , open-ended question) At the 
very least the qualitative observations can serve as the basis for subsequent, 
more formal categones 

One question that arises is whether the subject should be told before 
he contacts the expenmenter that he will be asked to describe the expen- 


menter’s behavior If the subject knows he is to descnbe the expenmenter, 
he may make more careful observations However, he may also be dis- 
tracted from the experimental task and therefore perform as a rather atypi- 
cal subject In addition, his having been asked by the principal investigator 
to carefully observe the experimenter may significantly alter the nature of 
the subject’s relationship to his experimenter The subject may feel himself 
to be in a kind of collusion with the pnncipal investigator and not at all 
subordinate in status to the expenmenter His increase m status relative to 
the status of the expenmenter may make him less susceptible to the unin- 
tentional influence of the experimenter The gam of more careful, sensitized 
observation of expenmenter behavior accruing from the subject’s set to 
0 ser\e may be offset by the loss of ecological validity arising from the 
subject s altered concentration on his task and his altered relative status 
An empirical evaluation of the gams and losses may be obtained if half the 
su J®cls 0 the expenment are told beforehand to observe the experimenter 
care u y, and half the subjects are told nothing about their subsequent task 
o esen mg the expenmenter The two groups of subjects can then be 
mparc ot on their description of the experimenter and on the per- 
formance of their experimental task 

employment of subjects as observers is clearly a case of participant 

obser\crship, and this IS its - - ^ ^ J 


.1. , greatest strength and greatest weakness Being 

notf wh-it ' experimental situation gives the best opportunity to 

nme tim through a variety of communication channels At the 

nnf? ^ participant is busy with his own task performance 

and perhaps too deeply involved in the interaction to be “objective ” Alter- 

me oso oservation of experimenter behavior, therefore, become 

important 


.11 I clinical psychologists, psychiatnsts, 

all make their living in part by the careful observation of behavior These 
and other experts in obser\ation may be employed to observe the expen- 
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„ prove .0 be 

data obtamed from -^3-^ ,„ggests that the 

the more molar and the more function This may be due to 

former may serve the more useful p ^ „ although not made as 

the fact that such global judgments molecJar observations 

rehably. carry more socml ™4s to smile and too 

of glancing or smihng ^ j,g^„nt socil meamng Perhaps by 

many ways to glance, each with ctudies i e , a friendly 

indexing our more “rmcrease both the rehabihty and 

glance, a condescending smi »Tnenmenter behavior 

the predictive value of observations P ^,ng of experimenters’ 

^Before leavmg the topic ^ of a very special 

behavior, menUon should be mad P p^pg^^herg has suggested in a 

kmd of observer experimenter whose behavior was 

personal communication (1 ) study Ins own behavior as an 

filmed might find it especially ms ni j or hypotheses missed by 

experimenter He might be able to “ Je possibihty, how- 

other, less personaUy „ou,d jrave more to learn than to teach 

ever, that the experimenter hi others The experience of hstemng 

of his own behavior and of lU f students’ psychotherapy 

to one’s own psychotherapy behawm o p S and 

traimng by means of tape “ j-now ” 

perhaps t4 experimenter too, is the last to 


Reduction of Bias by Observer Presence 

The question of the effect of w^rasTthe more specific 

menter’s behavior has already been on his unmtenUonal influ- 

queshon of the effect of an observer s p presence of 

Le on his subjects It seemed unmtenUonal communication 

an observer might reduce dm exp observer's presence might 
of his expectancy to h.s Te experimenter of which the 

inhibit even those comraunicati ^^oilable that provide a preliminary 

experimenter IS unaware Some data V.kan-Klme, & 

answer to this question ( 

Grothe, 1964a) ^ ^ nhoto-ratmg task was administereU 

In this experiment the sum P por half the subjects, c 

by 5 experimenters to about 3° * j success, and for half the ’ 

penmenters were led to expect ratmP J Po^ each «P'""’'"‘": 

expenmenters were led to “P” ^ otj were monitored by one o e p 
several of his interactions wi 1 experiment . 

cipal investigators who sat m macnilude of expectancy e cc 

^ Table 20-1 shows the ° ,p® numbers in each column repr - 

expenmenters having been observed TUe 
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goes unobserved by a human observer it is lost and not recoverable Fortu 
nately, there are mechanical systems of permanently recording the expen 
menter’s behavior These mechanical systems, including sound tape 
recordings, silent film, sound film, and television tapes, are becoming in- 
creasingly available, technically more effective, and economically more 
feasible These recording systems differ from each other in the completeness 
of the recording of behavior, in the speed with which the records are avail- 
able for use, and in their cost 

Tape recording is the most practical system of permanent recording 
The machines are readily available, inexpensive, and easy to use However, 
they record only that behavior which can be heard, not that which can be 
seen Silent film, sound film, and video tape do record the behavior that can 
be seen and, in their less elaborate forms, can be surprisingly inexpensive 
Silent 8 mm film can be used with a tape recorder to provide a convenient 
record of behavior which can be both seen and heard Sound films, while 
more expensive and less easily available, provide a still better (more 
synchronized) record 


Developments in photographic technology make it no longer necessary 
to have studio conditions before good films can be obtained This seems 
quite important, since the bright hghts and seating arrangements formerly 
required might significantly affect the expenmenter’s behavior 

Whether experimenters should be informed that their behavior is being 
recorded is both a scientific and ethical question, and some of these issues 
w be discussed later It goes without saying, of course, that any records 
0 experimenter behavior obtained with or without his knowledge must be 
treated with utmost confidentiality An analopy to a clinically privileged 
commumcation is appropnate 

ih systems eliminates the need for the human observers, but 

ney do allow for the more leisurely observation of behavior The types of 
ju gments made by the observers of the permanently recorded behavior of 
e experimenter may be the same as those made by a direct observer of the 
xperimental interaction In addition, however, some more mechanical 
modes of categorizing are available (e g . see Mahl & Schulze, 1964) 
mnr. ••t “ penuauent record (on tape or film) of behavior is 

orimnnllv^'^u® °l’=‘'rv‘«ion of the behavior as it occurs 

third uiisscd On first observation can be observed on second, 

mnVp ihfir ° servation Larger groups of observers can simultaneously 
imnnrtnnt ^ °£*®**^ advantage that becomes increasingly more 

important as the judgments of behavior become more difficult or unreliable 
^ o servations of experimenter behavior, the reliability among 
the ^ In general, more molecular observations (e g , 

expenmerner is or is not smiling) will be found to be more reliable than 
more molar observations (e g . the expenmenter ts or is not friendly) How- 
, a oes not imply that variations in more molecular experimenter 
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„ .u. o, 

“Si" X “s"®”"’ 

creased among these affected experimenters. 


Correcting for Experimenter Behavior 

V j th#» t 


reciuig luit — 

Once we have observed what the for those of 

mental situation, we are m a results of his research, 

his unprogrammed behaviors that ijjects were to be treated iden- 

Suppose that in a certain expenm ] observers, who did 

ticaUy by their experimenter. Suppose control conditions, 

not know which subjects were in ,,liud to subjects’ expen- 

noted that the experimenter (who ■™g ‘ ^ ,,joots of the expen- 

mental condition) behaved "1^^ performance of the 

mental and control groups. A°y ^“\ artially or entirely due to the 
subjects of the two conditions nug P rechniques as analy- 

experimenter’sdifferenUal behawo^yAe^ of the 

sis of covariance or partal experimenter behavior which was 

treatment condition, holding constant that ejen 

confounded with the subjects’ treamentcondj^^^^ they obtain 

Individual differences 2mo“S ^ntrolled by knowledge of the ex- 
from their subjects can 

perimenters’ behavior in the «P"*„ ,he course of an expen- 

Expeiimenters’ . \,,,,^or vis-a-vis their subjects, and so 

ment. pLtice may change then b" do not bias the results 

may fatigue or boredom. Ey«" 1 , ^ experimenter’s hypothesis, they 

of L experiment in the d'" of Type II errors. Vana- 

may have undesired effects— genera y with variabihty m sub- 

bility in experimenter behavior o increase (erroneous) failures 

iect performance over time wi . 

reiect the null hypothesis. unoroerammed experimenter e 

A fairly extreme correction for behavior was in some 

is to drop the data obtained by an expe might be 

way verj deviant or " ^"f a cdd«d sentence in his instmct.ons 

an experimenter’s unwitung o elimination might seem to 

to his subject. Such - J-mcrs tend to behave in a 

matter. In fact, it is not. Espenmemern^l^^ ^ "C ?ar 

tributed manner, and it will e .. ^ ij barely acceptable w 

er’s behavior (e.g., instmc o ptuble. a hv a riven 

experimenter’s behavior bnrel) on» ob^ned b) a p en 

The final decision to drop or hichly susceptible to the 

experimenter from a U 

pretive bias of the principal insesugato 



350 


Methodological Implicahons 


TABLE 20-1 


Observer Presence and Expectancy Effects 


Experimenter 

Unobserved 

Observed 

A 

+2 68 

+0 25 

B 

+2 49 

+0 20 

C 

+1 20 

-2 00 

D 

+0 44 

+2 95 

E 

-0 33 

-0 88 

Weons 

+1 30 

+0 10 


sent the mean photo rating obtained from subjects believed to be low 
(failure) raters subtracted from the mean photo rating obtained from 
subjects believed to be high (success) raters The difference between the 
grand means might suggest that expectancy effects were reduced by the 
presence of an observer Such a conclusion would be misleading, however 
For four of the five experimenters (A, B, C, D) expectancy effects 
were significantly affected by an observer’s presence Two of the experi- 
menters (A, B) showed a significant reduction of expectancy effects when 
observed A third experimenter (C) not only showed a reduction of the 
expected biasing effect when observed, but actually tended to obtain data 
significantly opposite to that which he had been led to expect His bias went 
into reverse gear The fourth expenmenter (D) tended to obtain unbiased 
ata except when he was observed At those limes, he obtained data sig- 
nincantly biased in the predicted direction 

somewhat complex results can be interpreted best by postulating 
experimenters interpret an observer’s presence in different 
ways 0^ experimenters whose biasing effects disappeared or even re- 
yrsed in the observer’s presence may have interpreted the monitoring as 
n a empt to guard against subtle differential treatment of the subjects This 
in erprctation may have led to a reduction or reversal in any such differ- 
n I rcatment The experimenter whose expectancy effect became more 
c car y pronounced m the observer’s presence may have interpreted the 
monilonng as an attempt to insure that the expenment would turn out well 
1 c , ca to proper, predicted results It would seem worthwhile in 
u urc expenments to vary systematically the impression conveyed to mom 

of fho observer's presence Th.s 
might shed light on whether the hypothesis of different meanings is tenable 
For the present, we cannot draw any simple conclusions about the 
c cc s o an o sc^^c^s presence on the experimenter’s expectancy effects 
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TABLE 20-2 


Effects of Two Teaching Methods os a Function of 
Experimental Period 


Period 

1 

2 

3 

4 

5 

6 

Means 


METHODS 

Experimental 


1.2 

1.4 

1.5 
1.9 
2.0 
2.2 

1.7 


Control 

Difference 

1.1 

+0.1 

1.2 

+0.2 

1.3 

+0.2 

1.5 

+0.4 

1.6 

+0.4 

1.7 

+0.5 

1.4 

+0.3 


i, were and in terms of the hypothe- 

ment (rho = .97, p < .02). It “^erimental method becomes more 
may be due to the tact that the ne experienced teacher (or 

effective when employed by a mor . experimenter has 

when tested by a more effective ossible that the expen- 

become over time. On the ot er ^ groups in an increasingly « 
menter has treated the subjects of the two g F themselves. We 

tial way. and in a way unrelated the teacher as well as 

might suspect this especially then one not bUnd to treat- 

the examiner or, if he was only ,,aep the experimenter-ex- 

ment conditions. If efforts been mi.de_..o^^y P code” by the 

aminer blind, we might suspect 6 , might hypothesize that 

experimenter. In addition (f the results of the expenment 

ex^menter was unwittingly l«*tnmg to b.a ,,,5 growing 

or'^simply becoming a more S 

professioMlness of manner. The natu _^.tmatment interaction effect 
suggest which interpretation of such an 

is most reasonable. pxocriments is most effective w 

The method of ^“bd'V'dmg “P^ pains can 

experiment is designed rsubje^s of all "penmenta cond. 

assign equal or proportioual numbers f ) mken to insure tha 

tions to each phase of the «Pf ""jrom earlier- to later-contacted sub 
there will be no feedback of mformauon 
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should be made without knowledge of the subject’s performance Ideally, 
the rules for dropping data will be wntten before the expenment is begun 
and the decision to drop made by independent judges whose task is only 
to decide whether a given behavior violates a given rule For the near 
future, at any rate, this will be no easy matter, for we have looked at so 
few experimental interactions that we hardly have any rules (even of 
thumb) for what constitutes an adequate, true-to-program set of expen- 
menter behaviors As Friedman (19^) has pointed out, for the psycho- 
logical expenment, there is not yet an etiquette 

Although a major deviation of an expenmenter’s behavior from the be- 
havior intended (usually implicitly) by the pnncipal mvesbgator may signif 
icantly alter the intended experimental conditions, such a deviation does not 
necessarily result in either an alteration in the subject’s response or in an 
alteration of the magnitude of the expenmenter’s expectancy effect 
Whether such alterations have occurred can and should be specifically de- 
termined for each expenment 


inferring experimenter behavior 

Sometimes when there has been no direct observaUon of the experi- 
menter’s behavior we can still make useful inferences about his behavior 
dunng the expenment Such inferences can be based on an analysis of the 
resu ts of his research and related personal characteristics Some of these 
inferences are made on more quantitative bases, others on more qualitative 


QuantitaHve Bases of Inference 

earber chapters we have emphasized that some replication of an 
komr"!!?"!, '■'‘imred m order to assess an experimenter’s accuracy 
nenment^ assessment is, however, possible even when only a single ex- 
invnlve^ ^ single experiment are involved Replication in this sense 

2^2 shnL’T f mto earlier and later phases Table 

of two tenrti ^ ^ hypothetical experiment comparing the effects 

el~, It ™ ^“bjects’ performance The 

crouDs renr<-« '“bdivided into six periods with subjects of both 

groups represented equally m all pcnods 

of the exi»rlme^t'^*'"f^ methods, subjects who are contacted in later phases 
fro o -^nn i ™ O'’ ^“biects contacted earlier (rho = 

of ihe pTTv* ^'’bjects have been randomly assigned to phases 

sublls r r H of f-^Oback from earlier to later 

behav or hr r ’7" '"T "““"’’bly infer that the experimenter’s 
c ange over the course of the experiment He has perhaps be- 
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more consistently. In ')°'"behavior aXtoame'^more “properif 

the experiment overly vana „neriment “appropriately” variable in 

consistent, or whether he began e^'lriLnte/ later on. To 

behavior and became a more ^ f j |,ta of a normative sort 

help us answer that question, we need j^dditiona^ da 

about the magnitude of Jatic decUn^e in subject variability 

Perhaps more serious than the y treatment condi- 

is the differential dedme m rin^ental subjects’ performance 

tions. The decrease in variance o t performance variance of 

is proceeding more *0 d Consequence of that par- 

Jcontrol subjects, f ^^er this is ^ niUural c ^ 

ticular teaching method as a ^ to%ectancy efiects, can be 

whether it reflects some pb^^^^^lier in the cLe of differential incre- 
assessed only indirectly, as sugg reasoning that has been ap- 

“■ 

skewness and kurtosis.) 

Qualitative Bases of Inference 

Wehave seen thatwe maybe ableto^use.^^^^^^^ 

experimenter’s behavior on the '"Ct toes have even less basis from 

this basis of inference may seem, w J . mer’s behavior and yet be 

which to infer something about the expert 

forced to make such inferences. experiment a large number of com- 

Suppose we knew that 'n * g . computational errors 

putational errors had occurre hypothesis under tes . 

Lnrandomly distributed with ^CdCfor inferring that the experu^^^^^^^ 

might have some weak empirical g biased. The research showing 

“fleraction with his subjects bu.se computaUonal 

relationship between r"agmtude of ® P ^ (Rosenthal, Friedman, 
errors has; unfortunately uot y^^b^^CraiL, 1964 ). . 

r hk^P^; 

for inferring what his behavior dunng have a clearly doj- 

not very offen. if at all. There «c few ,beir 

mented history of producing ^ay about a resea 

On those occasions when «orke« aje h ,ab.” or “Nobody can ever 

“Oh, you can’t believe tha , i likely to be little documen j 

replicate X’s work anyway, there « 1 k ly^ such statemen^^^I 

ctntpment. In almost a decade of toimg ..evidence” that I should 
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jects But the logic of the method can be approximately and usefully applied 
to expenments that have already been conducted TTie subdivision of the 
experiment can take place on a post hoc basis and can, at the very least, 
raise interesting questions (e g , overall sigmficant differences may prove 
entirely attributable to subjects contacted m only one phase of the experi- 
ment) 

In our hypothetical example we have used a correlational method of 
analysis only for the sake of simplicity The basic method of analysis of 
subdivided expenments can be a treatment-x-order design, m which we 
would hope that only the treatment effect would prove significant Even 
though the mam effect due to order is not sigmficant there may be a sig- 
mficant linear regression which should be checked Such significant linear 
regression without sigmficant mam effects of order occurs when performance 
in subsequent phases changes by very small but very regular increments or 
decrements (see, e g , Snedecor, 1956, p 347) 

In an earlier chapter it was suggested that significant decreases in the 
anance o subjects peformance might serve as a clue to expenmenter 
^ experimenter may unwittingly alter his 

inrrp->!°^ T “shepherd” his subjects’ responses into an 

""se We can assess the hkehhood of this phe- 

efleets iinn" ^ to that descnbed for assessing expenmenter 

ellects upon mean performance ' ^ 

the eJDe*rimpntl!*'>°*V^* hypothetical variance of subjects’ responses for 
lects of both treat "'«thods descnbed earlier Later-contacted sub- 

Th decrla Tn variance of performance 

may fe due m t..' scLs shown in Table 20-2. 

vanable behavior ° ® increasing skill Some of his randomly 

behavior may have dropped out, so that he is treating subjects 


TABLE 20-3 


Performance 
mental Period 


Variances as o Function of Experi- 


Period 

1 

2 

3 

4 

5 

6 


methods 


^xpenmenlal 

15 

14 

12 

11 

9 

8 


Control 

15 

14 

14 

13 

12 

12 


Difference 

0 

0 

-2 

-2 

-3 

-4 
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In the last two chapters J^jsTn tpecmfexperi^^^ 

to help control expenmenter suggestions made earlier, we 

this chapter, which draws upon . ngjis the selection and training 

shaU consider on a possibly experimenter expectancy effects, 

of experimenters as an aid to the never influenced their sub- 

If there were certain Wnds of datacoTO „ese experi- 

iects unintentionally, we could m P experimenter s training 

menterscoUectourdata.Ifthe amou^^ nould establish 

were significant ° leetors such tha^ its graduates' data would 

training programs for data co 

unaffeid by their expectancies or hypotheses. 

THE SELECTION OF EXPERIMENTERS 

. .• Hiia collectors has been recog- 
The importance of careful se “ nf survey 
nized by social scientists w°*"8 ,j„ris, 1948). Hyman ° ' 

Cahalan, Tamulonls, & Verner, 947 . Harn_^^ 
laborators (1954) have an excel! errors 

istics of interviewers who are mor p errors in asking P 

data collection process. Thes= = further '"'“""“"""’rt" ,hese 

grammed questions, errors m F°“'"8 ^Ve may summanze thes 

recording the response, and *=*'.“ ‘^ ,er competence. More 
errors af all being relevant to '"'of eompc.ence is probab ) nm the 
interviewers make fewer ^ psychological expenmen ' jf 

problem when the data <=°''“‘°; “Jw '"°^en?in he 

Seated, better motivated, more careM^^^^ '°Te tss 

values, psychological . juipp it accurately than I jur- 

sense of doing what is asked f i„ ,hc conduct of large-scale su 
selected inte^iewers employed to assist 
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A ‘ set. or which we think they oug/it to get " 

more ‘T’ “ “''“‘■gato’s reputation for erring, or 

rnea^o n H '”fl“enced by his expectancy, doef not 

nnncmirhr'' “'"""S “"h ^^ror ot bias In 

Soi^a’nL T'’ f ” 'he loose sense, then, but 

hoursucht "“nr ™ ™>h”g 'o 'ehe the 

trouble Such assessment wiU be discussed in the next chapter 

in the exuLuner' have discussed the experimenter’s behavior 

their contro The “Peetancy effects and as a vehicle for 

not of cole mm and of control suggested here are 

corned irthTmTedml a Vr^^^^^ strategies of eontrol pre- 

to serve as additional tool f ° r"® ohapters Rather, they are intended 
sometimes prove especialll am' ^ expectancy effects which will 

appropnate In genii h™®*’ especially in- 

pectancy effects will hn' tnvestigator interested in controlling for ex- 
■n this vTumftm others o 'Tr"" " ^"ategies presented 

- best serve ^ 
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more standard experiments with subjeets whose usual “ 

beforehand For each coK dete^ned 

r'oarrr:;rrr;ri^^^ 

liTCb" S 5“-=. b. 

“sr. ,., .» . s.™ 

showed clearly a propensity to bias the outc No 

penment he showed only a J. ,5 a® My state of affairs 

evidence is available for suggesting experimenters’ biasing tenden- 

We do not know the degree we would have a large sample 

cies over a sample of Ja’„es of standard experiments in 

of prospecuve experimenters con ^ 5 . 

each of several different areas of defined by a tendency to bias 

cover IS that (1) there is a genera factors 

over a large range of types of of experimems/a (3) 

defined by a tendency to 'f to bias in only certain spe- 

there are specific factors specific expenments or 

cific expenments We might find fu j bias, whereas others 

some types of experiments are ^n,gnters Figure 21-1 shows 

are more likely to show biasing effects of undergone our 

the hypothetical profiles of three expenmenters w 

somewhat elaborate selection proce ure expectancy effects m 

Expenmenter A shows a ten ^ of emotional behavior m 

all his research — most especia y so Expenmenter B tends to bias 

humans, but less so in studies of perc p human and animal 

the results of his learmng research ^ gf bis expectancy only 

subjects Expenmenter C shows the b'^i ^ jj ^g bad to conduct all 
m studies of the emotional behavior of amm^^ ^g 

eight of these hypothetical expenmen E ^ ^^^b expenment with some 

would be able to choose one or more expenmenter s ex- 

hope of avoiding biasing effects “‘fgjexpenmenter C, and if we 
peLncy In almLt every case ,Lld hire him. all other 

were in the market for a research assistam 

things being equal nersonal validity index we are sug 

In proposing what amounts t P^^^^ cannot be appro- 

gesting a procedure that, at eas 1 

iThe prohlem d es.a« - t 

matter) was discussed in tne 
effect 
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veys Furthermore, more competent, more accurate experimenters are more, 
rather than less, likely to show expectancy effects on their subjects’ re- 
sponses, as we saw m an earlier chapter 

Hyman and his co workers do discuss personal correlates of mter- 
viewers who showed a greater biasing effect, but the biasing was usuaUy of 
e observer bias or interpreter bias vanety As far as could be determined, 
ere ave een no studies relating interviewer characterisbcs to interviewer 
expectancy bias in which, by independent observation of the respondents’ 
’.J, be determined that the bias affected the subjects’ responses 
rather than the observation, interpretation, or recording of responses In 
errnrc^nf ^ points out, cvcn when the term “bias” includes net 
vanahiM m interpretation, “Evidence on what 

nectation ^ predictors of tendencies to ideological or ex- 
well reviewS'^v M (P 302) What this hterature, so 

bodv of mfn ^ ® Stoup, offers us, then, is a pnnciple rather than a 

penLnter ^ ‘b‘= p^ological ex- 

experimenters^ exertin^TP'^'^.^'^^ descnbed the personal charactensUcs of 
tenstics were theoretirafr^ expectancy effects Although these charac- 
with experimenter hia ^ ‘‘'•eresting, the magmtude of their correlation 

who are less professional / ^ would select as experimenters people 

less interested Pumo« r i ^“"^istent, of lower status, more tense, and 

oibiasburm th'Tori; 

read a journal renort of a P®>^haps far more serious, errors When we 
er’s having been expenment- 

doubt that the exnenmf. ’ consistent, and competent, or we would 
maintain high standardc "f conducted as reported And if we must 
hme of developine necessarily have a harder 

pectancy effects As our e •hat will predict experimenter ex- 

respect to such vanables become more homogeneous with 

diet bias less and less well a*” ^ 'ficnce we will find these vanables to pre- 
tion in the variance of eithe ^ statistical consequence, i e , a reduc- 
rcduction m the resulting corr.^ ''Enables to be correlated leads to a 
select experimenters'’ ^ What methods, then, can be used to 


wen as a si 

tion in the variance of either nf t ^ » * ~ ’ 

reduction m the resulting pnrroi^. ''!? y^^rmbles to be correlated leads to 
select expenmenters*’ 

The Method otsumpfe experiment 

Hyman and his collaborators 

tests in the case of interviewer , suggest the use of performan 
search organizations, this techniau^ cction, and as employed in survey r 
mizing coding bias The ultimat ^ he effective, at least in mir 

situation of the expenmenter would .rJ’ ■“"I*’’' techniques applied to If 
nvolve his actually conducting one c 



361 


Personnel Considerations 

separately for each experiment, or r ^ correlated with already 
experiments m the standard battery, can ,he de- 

existmg or specially devised f ,Ximc Test! can be ad- 

^s^ lrc"nd ‘S; .ban experiments can be conducted 

the training of experimenters 

in our discussion of the trajmng of expenmen.ers we 

mg broadly enough to include ‘ i„erature to come from 

the-)ob traimng Again we find most of t 
the field of survey research 

Amount of Training 

Hyman’s group (1954). m “™"®„o,7^enfncTd « 
viewer competence and bias, conclu e results This 

were somewhat more competent pomUng out that selecUve 

conclusion, tentauvely offered, they temp y P interviewers 

retention of interviewers might ^ orgamzation— expenence may 

may have greater longevity with the ^ Other workers dis- 

be the dependent rather than the m p Hyman et al Cantnl 

agree with even the modest ooado^'o” ^^/d^gcrence , 1 ,, ,„ahty 
(1944) reported that training did no (1958) reported that census 

of data obtained Similarly Eckler an types of 

interviewers showed no decrease in 

questions when additional training was prov experienced 

The lore of psychological the more inexpenenced 

experimenters are at least more ,„terviewer, there may be a 

This may well be true As m the case ofto^^^ data 

selective retention within the era f_]i„rving directions But the lore o 
collection-competent in the sense of foM b„„een expen- 

psychological research suggests ess expectancy effects - 

mLer’s experience and the provide at least 

There have been two “'’f™ th^eSet^f expenence or training on 
some indirect evidence beanng success that a 

lore of a„mro,..os.ca. - 

rcn« f- uTc— H= -1.. w..h 


tre of anthropological hkely to be m criu* \ 

e .-loaally) “ ut“ “'“S'S!' overlap. 

This certainly seems reasonable, b . show very consi 

out the lore on the average . ^^30 some professionals 

some amateur observers erring 
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FIGURE 2U1 

Expectancy Effects as a Function of Type of Experiment 

pnately employed by the ordinary principal investigator in search of a 
research assistant For one thing, this simply cannot be done to the gradu- 
ate student or undergraduate who wants to work for a given investigator 
Such selection may be educationally inappropriate from the student’s point 
of view If the experiments are designed only as a selection device there is 
also a certain indignity involved for the student The procedure is expensive, 
time-consuming, and boring It requires some institutionalized system of im- 
plementauon It does, m fact, suggest the creation of a new profession with 
Its own system of selection and training We shall return to this recom- 
mendation later 

Our pnmary concern in this discussion of the selection of expenment- 
ers has been selection for minimal expectancy effects But the job sample 
me o permits us also to screen out potential experimenters who find it 
° highly programmed procedures Although there is a cor- 

nnf lit^i t mtelligence and accuracy in carrying out instructions, it is 

Ypi ° 3 selected group of potential experimenters 

individual differences in the skill with which our research 
recorriino ttinir behavior programs The direct observation or the 

behavior^ H sound films of the potential experimenter’s 

wherr n ® ^ “penment permits us to assess 

whether any procedural deviations are too great to tolerate By the ob- 

tehavir’n th of *0 expeLenter’s 

LuH K ah I : experiments, we may be able to 

gauge hs abil ty to learn to behave m that stLdard fashion we would like 
tJl timately, it may prove feasible to develop tests and questionnaires 
that wiU predict an experimenter’s proneness to the exertion ot expectancy 
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fplk of bias evervthmK will be all nght What little evidenee there is bear- 

tried to guard against it co'ndition' 

on whether subjects were in th pe Halev which suggest that, 

There are also some data, collected by ™ ,ked to 

If anything, expectancy effects increase when experimenters 

try to avoid them , . so helpful to 

It seems incongruous that up and evaluating 

education, business, industry, an aj^ntion to the training of psy- 

traimng programs, have J u„n family We have been 

chological experimenters— the mem mental health expert 

hke tL physician who -f - “e Lrcurrently employed 

who neglects his own family If — ^gnd no systematic pattern, not 

for the training of our research assistan , collection Many experi- 

even explicit assumptions about ^^served in the data coUcction 

menters, perhaps most, have never researchers, then, we lag 

process or have even "Scorned by some, m the application of 

far behind those “applied fields, so scorn ) 

the pnnciples of learning is thoroughly trained in his data 

The chnical psychologist, ’ ,etaction with his patients and 
collection process He is observed in „i,dation of various methods of 
given feedback We may lament the lack Jd^ evaluated, and significant 
supervision, but at least the me acoects of training and supervision 

reLrch has shown that even 1961 ) 

can be empirically investigated ( ® nrpamaations have training man- 

In the area of survey ^ error reduction, at 

uals which, although also about the problem (Hyman 

least represent some self-conscious problems of both se ec- 

et al , 1954) Perhaps the ultimate in , 1 ^^ procedures employed 

tion and training of data ‘^“"ectors is uionly known as the “Kinsey 

by the Institute for Sex Research (m research they have employed 

Group”) Over the several decades considered for employment 

only 3 percent of the applicants .merviewers employed by the 

(pLeroy, 1963) The grand W*®' , acted group The Institute knew 

Institute Ls. then, an extreme^ ,ected accordingly Although 

the criteria its interviewers had to me . success of their se ec lo 

we might wish for an empirical ‘^valuat on of m .^e 

and traimng procedures, we could hardly P 

selection of data collectors nsvchologists, have paid so little atten 

One of the reasons that we, a® P ^ ^ 5 , cm from the 

tion to our own training as expen „uout data collection The e e 
of a specific belief and a specific va'ue about 
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the magnitude of expectancy bias (Rtwenthal, Persinger, Mulry, Vikan- 
Kline, & Grothe, 1964a, 1964b) In one of these studies (a) all expen- 
menters had served as data collectors once before, whereas m the other 
(b) none had any prior research experience The two studies were not 
specifically designed for this companson, and so any conclusions are tenta- 
tive, at best It did appear, however, that magnitude of expectancy effects 
was not particularly related to the experimenters’ expenence If anythmg, 
the more experienced expenmenters showed a greater biasing effect and 
were less variable in the degree of their bias It would even be reasonable to 
suggest that more experienced expenmenters should show greater expect- 
ancy effects With more expenence, expenmenters gam in self-confidence 
and perhaps behave in a more professional manner In an earlier chapter 
we saw that more professional expenmenters exerted more biasing influ- 
ence on their subjects 

Further indirect evidence comes from an examination of the results 
of the second of the two cited studies (b) Among that group of inex- 
perienced experimenters some were made more conscious of their pro 
ce ures as determinants of the results of their research This amounted to a 
minimal training (or educational) effort The expenmenters who were 
made minimally more procedure-conscious showed greater biasing effects 
m the data they obtained from their subjects The minimal training pro- 
experimenters to feel the importance of their 
^ ^ ^ lector more keenly They may have conveyed to their sub- 
status enhancement, and as we saw in an earlier 
» ^penmenters of higher perceived status tend to exert a greater 

degree of expectancy effect 

findings impressed by the absence of well estabhshed 
effects and relationship between experimenter expectancy 

conclusion training and expenence If forced to draw some 

trained more p ^ evidence there is, we might conclude that better 
in carrwnp out expenmenters are likely to be more competent 

sameTme because the mte'”"' 

hkelv to eninv ^ u u experienced, better trained experimenter is 

more profeLLai^I!''” “f his subjects and behave in a 

occur are more likely ITresul'nn deviations that do 

mg effect of the expLmenter’s 

Type of Training 

should train''expen™nters 

minimize their Lpeclancv eft , ™'“ ‘''m'' competence generally and to 
assumption, however that if ol'tv 'P“‘!''^‘‘‘'>' Tliere is an undocumented 
’ niy we tell our expenmenters about the pit- 
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™. a» .o, '"ft 

a part ot "s „□ neeaasaay coirelalion beta-aea the edu- 

be done as it now is. But there the scientific funcUon of 

cational function of serving as e P sensibly evolve. One very natural 
data collection. Divisions of labor replications or 

division would be between pi conducted by the indi- 

cross validations. The former wou ^^^t profitably be 

vidual invesdgator and h"*®" ^ ^{lich selects Ind trains professional 
contracted to a large research age y 

experimenters and jicai we need only remind ourselves 

If this proposal should seem ’ jests validated, and expen- 

that one can already proposed here simply extends the 

mental animals bred to order J on a contract basis 

limits of the kind of data that „t, .election and traimng of 

The details of setting “P L.j of behavioral research are 

professional experimenters ^ require the support probably 

complex. They would be expensiv agencies. The various agencies 

of both universities and tiroposfd institutes would need to be 

now functioning most nearly hke th p P - yy utilized. The ideal 
consulted so that their experience “"'f ’’j^P/^hapter could be employed 

selection procedure suggested ®^''' . gscouldbedevelopedwithcon- 

alongwithothers.Differenttraimngpr^du increasing experimenter 

tinuL evaluation of their relative to the development of 

competence and decreasing biased ^ors^^ , , „ore job-related pro- 

manLs which may or may P™'! could observe the dam- 
cedures may be introduced. Traiuee "ZP^ The trainee s 

collecting behavior of “ideal" by supervisors or. if on film, by 

f. „e couldbe of any procedural deviations. 

himself to iearn j r „,nfpecinn. van- 


“rrarcouldTemomTored^^^^^^^^^ 

supe^sors and by the trainee h«nself to to" p„fess.on, v^ 

In the early days of the development or s .„y 

abUity of procedures of setoon " educational 

important. Amount and type . and the didactic and perfom 

telfigence, motor skiU, personahty vanaH uted to vary so that the 

anef types of training '"'‘'’"‘^%"’’°^etimenters and training programs may 
efiectiveness of various types of expenm 

be assessed. , . ^ professional “P”""®"’” e di- 

The emotional investment of P That is the perform 

coUecting the most “toate data p^si ^otoes 

mension on which his rewards ^ his hypothesis. H^o'beses 

would not be in obtaining data PP , investigator and not of th 
would remain the business of ‘he pn”e P" ti,e to obtain biased dma 

coueetor. There might, in ‘h^ie scientist-experimente or^^e 

by the professional experimen er ij.5ional experimenters 

graduate student-experimenter. 
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that data collection is simple, if not simple-minded, and that anybody who 
can reach graduate school can cany out an experimental procedure The 
associated value is that data are to be highly pnzed but data collection is 
not The young postdoctoral psychologist can hardly wait to turn the 
burdens of data collection over to hts graduate student assistants Not all 
psychologists share this belief and the associated value, of course Extremely 
sophisticated investigators have pointed out informally that some of their 
graduate research assistants can, and some cannot, carry out at least some 
experimental procedures The fact that some cannot is often learned fairly 
late in the game, often at some cost to both the expenmenter and the pnn- 
cipal investigator Such instances are a tribute to our neglect of both selec- 
tion and training procedures 


The Professional Experimenter 

Science implies observation and the collection of data The scientist is 
responsible for the collection of the appropriate data, but it need not be his 
eye at the telescope or microscope nor his pencil mark indicating how a 
respondent will vote In survey research the interviewer is not the scientist 
In medical research the laboratory technician is not the scientist Each of 
these data collectors is a member of an honorable profession and is perhaps 
more expert and less biased than the scientist himself In psychology, how- 
ever, the scientist himself is commonly the experimenter, or if he has “out- 
pown the running of subjects, a scientist-in-traimng is the collector of the 
a s hampers both the selection and training of experimenters who are 
both competent and unbiased 

What IS needed is a new profession, the profession of behavioral ex- 
analogdus to the professional interviewer and the laboratory 
finH j professional experimenter will be well selected, well trained, 

data j profession because he is interested in 

fore an because it is expected as something to be done be- 

Quicklv tn sgTCc Can be earned and as something to be delegated 

traminpnTrvpH^ graduate students Careful, expensive selection and 
new nrofe^icin warranted because of the greater longevity of the 

St oS and ' There wiU be no conL between 

studenl be m the case of a brilliant 

behavioral exnenmp ^ ®™P^y happens to be inept at collecting data in 

from a scientific career betaufeoTft 

and our<5 Th^»rA ,c « ^ ineptitude This becomes his loss 

ments desiPn thp ° should not conceive of needed expen- 

a university or pnvate™ ariTihe^a^ T""'’ 

tions (e g .National Op.mon Resea”? ttuTerT' ^ ' 
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BLIND CONTACT 

It seems plausible to reason that poup, then he 

whether the subject is in tbe ^ the subject “should" re- 

can have no validly based expec ancy , treatment condition cannot 

spond The experimenter “bUnd ‘o **’® ^ differentially as a function of 

be expected unintentionally to trea 1 effective idea in the field of 
their ^group membership This is an old and effective 

pharmacology , „ jo the situation in which the 

The so-called single blind stu y ^ administered 

patient or subject is kept from know S ^ ® j^^pt from knowing 

When both subject and experimenter (P called “double-bhnd 

what drug has been administered, the p ^ technique is over 120 
(Beecher: 1959, Levitt, Wt'so"; *95^ Vienna Medical 

years old, having been p,„l; & Hartfelder, 1963) Haas 

Leiety at least at early as 1844 convincing evidence tha 

and his co-authors have recent y pr warranted In a review 

the use of the double-blind study is ™^J^^„ds of subjects and many 
nearly 100 placebo studies, '■"'“•""J j^cebo works bsst "'>’en th 
different disorders, they observe . Apparently, when the e p 

double-blind method has been e p y p^igpce given his su jec p 
menter (doctor) does not ‘‘“«"er result 

tient) IS inert, he expects, and g » of the tem 

1 There is a certain amount %metim^ somcnni« the 

“double blind ’ Always the subject ^ the research phys a ^gre is 

IS the subject’s personal physician, We will adopt 

person who actually t blind, etc , to add ^ double blind study is 

talk, too, of triple blind quadrup . g^^pcriment such t . know what the 

a usage m speaking of .he ^Pb,=c.s « P'™®'Cenm=nt is over 

one m which no one having direct coni^ until tnc 

subjects' treatment condition wi _ . 

‘ Double blind" for us will mean 
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or develop hypotheses, and the strategies for the control of expectancy 
effects descnbed m the last two chapters and in the next two chapters can 
be employed In fact, they can be more effectively employed with profes- 
sional experimenters because there will be less conflict with educational 
goals The professional expenmenter wants to be kept blind, but the gradu- 
ate student might properly feel imposed upon if he were kept from knowing 
what research he was conducting 

Some of the values to be acquired by the professional expenmenter 
are, of course, already found among behavioral scientists, but their increased 
articulation might have a beneficial feedback effect on those of us back at 
the umversities We do too often judge a piece of research, not by its careful 
execution and the data’s freedom from error, but by whether the results 
confirm our expectations Many universities give implicit recogmtion to 
this tendency by protecting their doctoral candidates with a kind of con- 
tract The essence of this contractual procedure is that the soundness of a 
piece of research is to be judged without reference to the results If a quali 
fied group of judges (i e , the doctoral committee) feels that a piece of 
research is well designed then it must be acceptable no matter how the data 
fall® ^ 

th contractual arrangements exist is a good and reasonable 

contractual arrangements are necessary is a somewhat sad 
an so enng situation It is a situation that suggests we are too often more 
m ereste m demonstrating that we already “know” how nature works than 
m tiymg to learn how, m fact, she does work 




369 


Blind and Minimized Contact 

their research assistartts to subjects. Experi- 

they had assistants the magnitude of data 

“pererrhad obtained from their subjects. Research 

their subjects’ responses to a very g . jj jo keep research 

mitted to their research assistan^. In .^P f biLd their 

assistants blind, those whose P"“‘P . subjects’ responses more, 

subjects’ responses more also bmsed * ^ rimenters’ fesing effeet 

^ Here, then, is an '"‘““‘‘"S p^aboloffcd impli- 

once-removed, which has importan methodological implications, 

cations which will be discussed later o ^ assistants what to ex- 

however, are clear. Simply not te °6 experimental or control 

pent from a given subject (i.e., ™ ® , subtle way, by tone and/or 

Lbjects) <^oes.nm^r^l^^:;r ::^Urm ib 


s) does not insure real u“overinform their research as- 

gesture, experimenters may bUnd method is not impugned by our 

. The principle o ‘"o 
tmaings; but the difficulty of uup e 
experimenter “blindness” is emphasized. 


AdditionalProblemsofMaintainingBUndness ^ die 

We have shown that the P""7^ llere^l wm show that an- 
inadvertent failure of the double-bimd method^ known 

Other source of such fmlure may c 

in pharmacological research. ..hetances are compared, sometimes 

When active and inert chemma S„me paUents 

the active substance has an irreleva example. Thus the experime 

pven the “real” drug may change co o j,, j,e t e rug 

knows, at least for these subjects, that tney 

group than the placebo control group. ^ effects” may occur. 

^ In psychological experiments, too, such ..duble^ Peop e 

sume an experiment in which arousing experience or w o 

who have just been through ““’'i' „tly in an experimental situaU . 
high on a test of anxiety may be ave "single blind" 

e-The work of Martin Wth^h no simation 

"nC?s Yarml'riUse communicate to .be 

(even if not from the 

subjects how they are expected to 



368 


Methodological Implications 


Psychologists have been slow to adopt the double-blind method for 
other than psychopharmacological research (Shapiro, 1960, p 125), though 
Wolf (1964) reports that in 1889 Delboeuf proposed the double-blind 
method for research in hypnosis It is the unusual data collector today who 
does not know whether his subject is a member of the experimental or con- 
trol group (eg, Babich, Jacobson, Bubash, & Jacobson, 1965) The sug- 
gestion to have expenmenters contact their subjects under blind conditions 
IS imphed not only logically but empincally as well, if we may draw on the 
data of the pharmacologists In addition, it is not a suggestion that would 
work an impossible hardship on the researcher More and more data are 
being collected by less and less sophisticated (or, at least, less academically 
advanced) student research assistants who could be kept umnformed of the 
hypothesis and overall design of the expenment, as well as the treatment 
conditions to which each subject belongs If these students were too sophis- 
ticated, or if the principal investigator preferred to do so from educational 
and ethical considerations, assistants could be told exactly why they must 
remain blind In order to be somewhat more convinced about the efficacy 
of the double-bhnd procedure among psychological experimenters, however, 
It was decided to try the technique out (Rosenthal, Persinger, Vikan-Kline, 
&Mulry, 1963) 


A Test of Blind Experimentation 

Fourteen graduate students (II males and 3 females) administered the 
standard person perception expenment to a total of 76 introductory psy- 
c ology students (about half were males and half were females) As m 
^ j half the experimenters were led to expect low photo raUngs 

an al were led to expect high photo ratings from their subjects 

txpenmenters were told that those who adhered most stnctly to the 
expenmental procedure and obtained the “best” data would be awarded 
rcsearc grants At the conclusion of this phase of the expenment all 
of $14 Of this amount $10 repre- 

-inri ^ for continuing in the role of “pnncipal investigators, 

and $4 was used to pay then research assistants 

° oxpenmentcrs who were able to continue m the 

investigators” two research assistants were ran* 
were^trained”^ assistants were males Assistants 

bv ihr ('Ynp ^ ^^^nmental procedure and were paid for their time 
ratinp crs Each research assistant then conducted the photo- 

dcnis OMhp sample of six introductory psychology stu- 

the onginal instructions to expenmenters, the instructions to 

rch assistants made no mention of what ratings should be expected 
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hnr^lv affected bv this particular constant error, that the effect of anxiety 

l;:;rd"EvtnTtheJei^^^^ 

. . nl f OO 1 


Effect of Idiosyncratic Hypothesis on Results of a 
Double-Blind Study 
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Attecteo scorw* 

If the experimenter is not entire!) ‘’“‘„p"°he mean tlfcrenee ^ 

o groups, and which subjects ^ „ true c«n "loufh «h 

a groups IS more l.hel) to be f « 'f, 'cond.uons are I. «-ll ^ 
nmemer does not know what «hc h- ma) 

rent to him that a .5 to be the better pcifotm.^ r 

aps irrelcs anti) , h)polhesirc » • P group »' “ 

behase differcntU to the subjects ,j ,jrj to K p i 

athesis On a chance basis half the time th. 
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The “blind” experimenter may then covertly “diagnose” the level of anxiety 
and, if he knows the hypothesis, bias the results of the expenment m the ex- 
pected direction or, by bending over backward to avoid bias, “spoil” the 
study There are many expenmental treatments or measurements that may 
be assessed unintentionally by the “blind ’ data collector A recent example 
of this denves from a finding that subjects scoring high in need for social 
approval arrived earher at the site of the expenment (r = -f 40, p = 003, 
Rosenthal, Kohn, Greenfield, & Carota, 1965) In effect, to see a subject 
amve is to know something about him that often is meant to remain un- 
known Amval time, overt anxiety, skin color changes, and potentially 
hundreds of other, more subtle signs may break down the most carefully 
arranged double-blind study 


Irrelevant Expectancies 

Even a truly blind experimenter is hkely to have or to develop some 
expectancy about his subjects’ behavior If he does not know the expen- 
mental hypotheses — i e , how the subjects ought to behave — then his idio- 
syncratic expectancies are likely to be irrelevant to the hypotheses under 
investigation From the point of view of the particular design of the study, 
however, these more or less “random” idiosyncratic hypotheses may serve 
to increase the error vanance and, from the principal investigator’s point 
0 View, increase the likelihood of Type II errors If the expenmenter did 
not know the hypotheses being tested but d/d know to which group each 
su jeci belonged, the results of the study are more likely to be biased in the 
<iircction of the hypothesis (or opposite to it) rather than biased irrelevantly 
w respect to the hypothesis We can illustrate these considerations by 
intcUcctual'^rf*^ earlier example of the study of the effects of anxiety on 

pnncipal investigator exposes a random half of his 
are PTnncA^T cxpenence, while the remaimng subjects 

who rrii/./.! ^ involving no anxiety arousal The expenmenter 

nor the ir(-ft ^ *"*ellcctual performance data does not know the hypothesis 
the ^enibership of any subject Suppose, however, that 

tend ioh(' nn? irrelevant covert hypothesis that tall, thin people 

what difierenti^^^ ^ therefore unintentionally treats them some- 

Tahlr 77^1 ° n ^ ^‘^^tili they obtain higher performance scores 
results of !hr cYrJ effect of this irrelevant hypothesis on the 

as thc\ miehf intellectual performance scores arc tabulated 

i^lcvanre?!^"' '"r '-‘thout the effects of the 

tall thin of the data collector Note that there was only one 

thc'daia coni-re whose performance score was affected by 

!Ss obslned “ 5-po.nt effect on these sub- 

J c table shows that the mean performance scores arc 
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havior ‘ 

ThP “total-blind” design. The second strategy to be descnbed is 

„„ .Xj •- s, S” «».“=.» - 

M..rch progiiun This slralegy. wh«i app eapenhieoter blmdaess, 

la '"and ball the Lpenmenters are led to expect 

pect high photo ratings (+5 ) “Labons were induced by a written state- 
low photo ratings (— 5),thesee P jtujy employing only 

meat of how subjects “would perfom assigned to each ex- 

10 expenmenters a different researc r ^5 expectancy and 

penmenter The 10 sets of ^ randomly and bbndly assigned 

five inducing the —5 expectancy, w would be randomly assigned 

to the 10 rooms The 10 “P="“” .‘jast minute instructions" 

to their rooms, where they would r experimental conditions Not 

which, in fact, were the means for nr® 8 experimenters’ “last- 

untd the conclusion of the with the data sheets, would 

minute instructions” would be pic e P ® ^ expenmenter (or sub- 

anyone know in what experimental treatment 

ject) had been' , were several different 

In the more complex situaUon the very same pro- 

expectancies and other expenmen a (.oaiplex situation, consider an 

cedures were followed To lUustra e -xpenmenters per condiUon If 

expenment requmng 4 condiUons and 6 expenm 

iTUe presence nod vanelv (T/sT 

sTSa" -r nSns -prv/. 

because no one has laid \ ® n would be an er^ * K--nce of certain 

nonsmilmg and nonglancing be expenmcnl The unusual, 

none of Ihis behavior should <KCur ra „ay have a far mor ^ ^ 

socially expecled facial geslural . j. jhan Ihcir presence ( gx-cnmenlcrs 
even bizarre, effect “P™ 'nlurpcrsunal ‘’=>'Xal.om fo"”i'''"S 
1963b) In speaking of *=« ““'’™f”™^ly have any ■“P'f '^“inng as Ihe 
we should note that they do control group variable these 

Ihe resulls of an expemnenlal « com™ ^ randomly vari^^^^ 

unprogrammed “ '‘j,ate expenmenler "P"''^Lanimed behaviors as 

behaviors cannol serve to medime e^ “ mediate ex 

subjects are differentially *‘ u„rSn these behaviors serve to m 

a function of their treatment expenmcntal 

■"“ecrorc^?;- ^ 

rooms) but with the restriction t 
equal as possible 
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port the principal investigator’s hypothesis and half the time it should tend 
to weaken it But, in either case, we can be misled as to the nature of the 
real state of affairs It seems, therefore, highly desirable that the experi- 
menter be unaware of which subjects constitute a group even when he does 
not know what treatments have been admimstered to any group 


Procedures Helping to Maintain Blindness 

We have seen that both subject and principal investigator can serve 
as sources of umntended cues leading to the breakdown of expenmenter 
blmdness In the next major section of this chapter we shall discuss vanous 
strategies that may help maintain blmdness by helping to reduce contact be- 
tween an expenmenter and his subject In this section we shall discuss two 
strategies designed to help the expenmenter maintain blmdness m spite 
of his having some contact with the pnncipal investigator 


Avoiding feedback from the principal investigator. The first of these 
strategies is implied by the findings described in the chapter deahng with the 
effects of early data returns (the Ebbinghaus effect) the data collector 
should not tell the principal investigator the nature of the early returns 
This IS a bit of a psychological hardship for a research group eager 
to learn whether they do or don’t “have something ” Still, many studies 
are conducted within a short enough penod of time that the hardship would 
not be excessive ^ Any contact with the pnncipal investigator, including 
many unavoidable sorts, is likely to increase the chance of a breakdown 
of bhndness,” but the report of early returns may be especially damaging 
uppose that over the course of an experiment a bhnd expenmenter is 
umntenuonally having some sort of vanable effect on subjects For ex- 
amp e, ear y m the data collection process he may be smiling more at sub- 
jccts he sees as more anxious, but later on he smiles somewhat less at them 
reported to the principal investigator there will 
fh*. ^ positive or negative reactions to the news If 

n on IS positive, the principal investigator’s pleasure may serve as 

tn n ‘^ohector’s unprogrammed expenmental behavior — 

Wha* was a randomly vanable bit of un- 
into the nrpH ^ Coincidentally serving to effect subjects’ behavior 
havior on^th(- becomes a systematically biasing be- 
rcst of thp H ? °i! * ^ expenmenter which will continue throughout the 

untel H data returns are in the 

P irec ion and the principal investigator’s reaction is negative, 

cxpcnmcntcra An^exMnrnpm^^* ^ 8^'ned from employing a large sample of 
«^nmem:n.^orkmrC^^^^^ much'soLe^ with a number o 

desire on the cart nf s‘muUaneously, that there is a far less urgent 

aesirc on the part of the principal investigator to learn how the data arc coming out 
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that we would then also eUminate the operation of experimenter expectancy 
effects. 

Automated Data Collection 

The day may yet come when the elimination of the experimenter, m 
person wm be aVidespread. well-ac«pted practice. Through the use o 
computers we may generate hypotheses, 

experimental treatment conditions frorn a popu a ? them, 

tioL, select our subjects randomly, invim then P^f 'cip^bon^ " . 

instnlct them, record and analyze them f P-^reltrwrruld not 
terpret and report the results. Even i t s J surrogates or 

be able to eliminate the “f ^h’,cb^ influence the output, 

colleagues must program the comp differential treatment 

However, there would at least be no “"P'' 6 .jtio„s in short, although 

of subjects as a function of then expenmen completely eliminated, 

experimenter or even machine enecis ca 

we can at least hope for unbiased effects. ,,,,on,otion and the elimina- 
Progress is being made along the trad ° research. Not 

tion of experimenter-subject contact '° . expectancy effects, many 

necessarily because of an interest '"/ . .j complexautomateddata- 

researchers employing ammal subjects a automation, however, gen- 

collection systems (McGuigan, >• . jgta production and not 

erally appuL only to the pe-^ ^s’^ie, 1951). Experi- 

to all his pre- and extra-expenme P home cage to the 

menter handling patterns in transpo g across experimenters 

experimental work area and back may °7,„tcondition to which 

but within experimenters as a ° transported to and from their 

the animal belongs.® Even if the ht still be an opportunity to 

home cages without human treatment conditions, 

treat differentially the animals of i e .-cated differently as a function 
Animals in their home cages nray .he handler is not 

of their cage labels even if these He still knows something of 

formally “an experimenter” or data co • different behavior is ex- 
psychological research procedures . jnnps. Earlier in this chap- 

pected of members of different . . jubiects constitute a treatment 

ter we showed how knowledge of whic J hypotheses being 

group can affect the results of the unknown, 

tested and the specific treatment ' subjects arc humans, also a^ 

Automated data collection, "h^'ubl ^ p,ct^ 

pearstobeontheincreaseand,as.n.hecaseo 

.such diflcrcndal handUna n "c mcdic.lon at crpcrinicnlcr 

condition was postulated cari.er ns a mmor 
expectancy efTects to animal subjee . 
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we ha\e 4 expenmental rooms we divide the experiment into 6 replicates, 
if we have 8 experimental rooms we divide the study into 3 replicates, if 
we have 12 expenmental rooms we divide the study into 2 rephcates, as- 
suming in all cases that we can arrange to have different expenmenters con- 
tact their subjects simultaneously Within each replicate each expenmental 
condition is represented equaUy Expenmental treatments, induced by 
wntten “instructions,” are put into envelopes, coded, randomly assigned to 
research rooms, and not associated with any given experimenter until the 


expenment is over 

Of course, the same logic can be apphed even if only one expenmental 
room were available It is our impression, however, that experimenters (or 
subjects) who find their way into early vs later stages of an expenment may 
be nonrandomly different Therefore, if we can have early- and later-partici- 
pating expenmenters or subjects equally represented in each treatment con- 
dition there may be less confounding of the treatment condition with these 
temporally associated personal charactenstics If we had only one room 
available for the data collection process, therefore, we would prefer to have 
each set of four expenmenters represent all four expenmental conditions 
Random assignment of the four expenmenters to the four conditions would 
have the additional advantage that if there were an unexpected attntion of 
experimenters toward the end of the expenment, there would be a more 
nearly equal distnbution of expenmenters among the vanous conditions 
All that we have said about our own research employing experimenters 
can be equally applied to other research employing subjects directly — that is, 
without intervening expenmenters All those experiments in which a wntten 
(or a tape-recorded) communication serves as the experimental mampula- 
tion can therefore be run * totally blind ” There appear to be few, if any* 
areas of behavioral research in which this strategy cannot be appropriately 
employed at least some of the time 


Before leaving the topic of blind contacts, mention should be made 
of a paradoxical question raised by Milton Rosenberg in a personal com- 
munication (1965) He suggested the interesting possibility that expen- 
n ers, nowing they were blind, might expect, and therefore obtain, 
vanable data The idea is sufficiently intriguing and 
1 j in terms of leading to increased Type II errors that 

the implied expenment should clearly be earned out 


MINIMIZED CONTACT 


It was"bv^no"m the blind contact strategy m general, we pointed out that 
L to ochieve Therefore, rf 

Iimmatc expenmentcr-subject contact altogether it would seem 
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Restricfing cues available to the experimenter. Cues to fte experi- 
mentH^d increase as he interacts with more subjects and as he interacts 
more with each subject. An incidental advantage of employing a poup of 

i.e., to Jm which subjects constUute a of 

mental condition might have been. J 

experimenter blindness may better avoid some 

During his contact with ^“J^j^tb/having subjects record their 

important unintentional cues from the subjM y ^ J 

ol responses. Them are many Sub- 
man subjects wherein responses are response on a clearly 

jects could then often be requested to record the P four 

sb«. I. «s 5- 

advantages would accrue. (1) T p . not looking 

blind would be increased. (2) The “P^” ’ys subsequent subjects 

at the data sheets, could avoid that “f ^ 3 ) iperirnemers’ 

attributable to his knowledge of the ear y biased when they do occur, 

recording errors, which, though rare, interpersonal contact 

would be virtually eliminated. (4) reduced thereby reducing the 

between experimenter and subject wou experimenter’s expectancy 

opportunity for the subtle communication of the expen 
(or other bias or effect) to his subjects. 

Some combined procedures. “/bfS'experimenter and 

be combined with the use of a screen ‘"'^rp ^ experimenter 

subject to achieve some of the advan requires less expensive 

to Ltact the subjects. This .or The tape recorder, 

equipment than the closed-circuit tel^sion —^^ k be 

ol of sight of the subject « * "P^t^rwareness) if earphones 

used to instruct the subject (withou experimenter was 

were provided. The impression, then, w instructional 

speaking over a telephonelike device. interaction, and when 

constancy, elimination of visua ^ '“'.j ^rding of response, no cpcts 
further combined with subjects s experimenter is physical y 

due to early data returns. At reouircd by some experimcnta 

present, therefore perhaps more /ea „nimed experimenter inpu 

manipulations. The only opportuni y colIecUon process be ore 

would be during the greeting p (and even this Ejecting p asc 

the experimenter retires behind . , i- also blind to the subj 

could be eliminated). If the “P®" , , , be particularly damaging, 

treatment condition, however, this s additional advan ap 

The use of earphones for the = 0 ^ = t fs .b^ 

that it may help the experimenter maintain 
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among researchers employing operant techniques. Written or tape-recorded 
instructional methods certainly seem to eliminate experimenter-subject 
contact. Although these methods should reduce any opportunity for the 
communication of experimenter expectancy effects, they would not eliminate 
such opportunity if there were nonblind experimenter-subject contact before 
the data collection phase of the experiment. 


Experiments Requiring Human Interaction 

It can be argued that there are experiments that make no sense unless 
a human interaction can occur between experimenter and subject, situations 
in which a written communication or tape recording alone simply would not 
do. 


Experimenter constancy. If this must be, then from all we have said 
the experimenter’s behavior should be as nearly constant as possible. There 
is a way in which we can achieve perfect constancy of experimenter be- 
havior, and that is to employ the identical experimenter’s input into each 
experimenter-subject interaction. This can be accomplished by filming an 
experimenter’s required behavior in the experiment, including sound track. 
TTie sound film can then be used to instruct the subject. This alone would be 
little better than the tape-recorded instruction method if subjects could see 
that the experimenter was on film. However, where one-way mirrors or a 
television camera (with or without film) and closed-circuit television moni- 
toring facilities are available, it would be a simple matter to give the im- 
pression of a “live” interaction. The situation could be structured for 
subjects so that they felt they could observe the experimenter and he could 
0 serve t em via the monitoring system. In this way constancy of experi- 
men er ^e arior could be assured without sacrificing the impression of 
veness of interaction which may be crucial in certain experimental con- 


g cucs available to the subject. Where experimenter-subject 
Earlirr j eliminated completely, it can at least be minimized, 

munr^tinn K reduction of the available channels of com- 

cxnerinip.nt<. ^ experimenter and subject might reduce the effects of the 
menter ^nf^ interposing a screen between experi- 

tion nf PT ^ reduce the available channels for the communica- 

from thf effects from experimenter to subject. However, cues 

litetihonri ° ^ ^^perimenter have also been shown to increase the 

exrv-rim ”^rimentcr expectant^ effects by serving to break down the 
cx[«nmcn er s blindness. It would, therefore, L desirable to restrict cues 
made available by the subject to the experimenter. 
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early attempts to minimize experimenter-subject contact. It is striking 
that so many of these efforts at greater control occurred in what might 
be called “borderline” areas of psychology. Even today it would be the 
rash parapsychologist who would not make every effort to minimize the 
contact between the experimenter and subject in a study of extrasensory 
perception. And this is all to the good. Also to the good is the fact 
that nonparapsycholog^sts would be outraged if such controls against 
expectancy effects were not employed. But not aU to the good is the 
fact that some of these same workers might be outraged if in their own 
less “borderline” areas of inquiry they were required to institute the 
same degree of control over their own expectancy effects. Clearly we 
have a double standard of required degree of control. Those behavioral 
data found hard to believe are checked and controlled far more carefully 
than those behavioral data found easier to believe (e.g., Babich et al., 
1965). What this amounts to, then, is a widespread interpretive bias which 
may serve to make it easier to demonstrate easily expected findings and 
harder to demonstrate intuitively less likely outcomes. In the overall conduct 
of the business of the behavioral sciences, this may lead to a pervasive bias 
to support hypotheses in keeping with beliefs of the times. Obviously the 
solution is not to make it easier to “demonstrate” unlikely events such as 
clairvoyance, rod-divining, talking animals, or muscle-reading. What is 
called for is the setting of equally strict standards of control against expect- 
ancy effects in the more prosaic, perhaps more important, everyday bread- 
and-butter areas of behavioral research. There should be no double 
standard; every area of behavioral inquiry should require the greatest 
possible control over the potential effects of experimenter expectancy and 
other sources of scientific error. 
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treatment conditions were to be created by the taped instructions The tape 
could be constructed so that the different instructions appeared m some 
random sequence unknown to the experimenter He would play one segment 
of the tape after another for sequences of subjects without knowing what 
instructions the subject had received through the earphones 


Effects of “Absent” Experimenters 


We menUoned earlier that the experimenter could never be ehminated 
completely, even from a fantasied computer-run expenment We repeat that 
restnction here There always are (and always will be) decisions that must 
be made by the experimenter which may umntentionally affect the subjects’ 
responses These decisions, however, should have no unprogrammed, 
differential effect upon the subjects constituting the different experimental 
conditions 

One sort of research that is erroneously beheved to involve no effect 
of the experimenter is the mail survey Letters requesting information 
(often from psychologists themselves) are legion There is no face-to-face 
contact between the questioner and the respondent Yet the wording of the 
letter may yield different rates of return and, among the respondents, dif- 
ferent kinds of responses Different data collectors interested in the same 
questions are likely to ask them m different ways, thereby eliciting different 
responses The advantage to the mail-survey technique, however, is that 
there, at least, we can specify exactly what the experimenter’s stimulus value 
was We can completely capture it simply by having a copy of the letter 


^ ^ letters convey something of the writer, so even more do tapes 

and films Expenmenler attributes cannot be ehminated Their effects 
^ ^ distanciated, randomized, or held constant over treatment 
condmons to avoid a bias m the comparison between groups 

Dlovma nr! ® relatively, of studies em- 

cffect of absent” expenmenler that it is difficult to assess the 

is suppests subjects’ responses What evidence there 

jects^ehavior hvT^^ u experimenter often does affect sub 

presam howeve/n.’ 196°) There .s at 

affect h'ls different er assume that an “absent” experimenter can 

his expenmental hypothec the direction of 


TTtc Double Standard for Expectancy Control 

and s^b!cct minimized contact between experimenter 

and eTsSe’re m l a "'’f Earlier in this book 

elsewhere in more detail (Rosenthal. 1965a) we have reviewed some 
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conducted because a difference between the experimental and control group 

" “Table 23-1 shows the generally resultant confounding of expenmeMd 
treatment conditions with the experimenter’s expectancy 9“ 

The condition in which the experimental treatment - ^ 

jects by a data collector who expects the occurrence of the treatment 


TABLE 23-1 


Confounding of Treatments with Experimenter Ex- 
pectancy 

treatment 

CONDITIONS 

Control 


experimental 


EXPECTANCY 


Occurrence 

Nonoccurrence 


effect. Cell D represents the =°"***°" ^o„ector who expects the non- 
mental treatment is associated wit a ^j^biarily the investigator is 
occurrence of the treatment e_ ^^^.^nfounded with experimenter 
interested in the treatment ett pxnectancy control groups 

expectancy. The addition of the from the ex- 

will permit the evaluation of the treatm requires the addition of 

pectancy effect. A “complete expectancy control” requires the 

both cells B and C, whereas ® P ,, _re those who will not re- 

addition of eitfier cell B or C. Su jec s in contacted by an experi- 

ceive the experimental treatment u w _ qpII c arc those who 
menter who expects a treatment effect 

will receive the experimental treatment but who wi 

experimenter who expects no treatment effect. 


HYPOTHETICAL OUTCOMES 


^ X M. -M. — — 

The result of the case of an 

parison with “complete expectancy attributable to c 

by a two-way analysis of variance yw a„ributablc to experimenter c.y 

experimental treatment, a effects. For the sake of simplici ). 

pectancy. and an interaction of these * " ^ variance can be only (D 

We may say that any of these three sources 
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In the last chapter we discussed some strategies attempting to minimize 
experimenter expectancy effects In the present chapter we shall discuss 
a strategy which essentially attempts to maximize experimenter expectancy 
effects by the employment of ‘ expectancy control groups ” 

The logic of the control group was well developed by Mill in 1843 and 
according to Boring (1954), had been anticipated a century earlier by 
Hume and two centuries earher by Bacon and Pascal ^ At least since the 
beginning of this century, psychologists have with increasing frequency 
employed control groups m their experiments (Solomon, 1949) Expect- 
ancy control groups represent a specific set of controls denved directly 
rom the research demonstrating the effects of experimenters’ expectancy 
on the results of their research 

Consider any experiment in which the effects of an expenmental and 
a control treatment are to be compared ^ The experiment is likely to be 


expcnment with ti,» t his brother in law Perier perform an 

up a mountain ihi* .-ni tube (barometer) As the lube was earned higher 

lefi at the bottom nf mercury dropped lower and lower A control tube was 

any hy an observer to note whether there 

mercury level "it ih* i« mercury A number of readings were made of the 

pressure at any two of' ihl th" one halfway down Measures of 

difference and measures at nlMhr® altitude illustrate Mills method of 

of that method the r three points illustrate the more elegant special case 

use of Tomr^ grou^ com« to ^ earlier example of the 

ticular research If cSJducS? iSav m™{!I 

‘■"■-"ssnifi.SrA'’', 

enl vanablc”^lhe°dncussTo*n'apphls^L* experimental manipulation as the independ 
m«m ho» th4 " e coM.imcd "> 

mentar and “contrnr prn.it« a Purpose a comparison between expcri 

Icmatc snblts eoSmm f “ not differ from a comparison between male »s 
InbieSs PPP'PtnnnBv, noneonformiPE subjects or hish" vs low anxious 
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perimental condition had a significant effect e^i^ed 

trolled If we had omitted the expectancy controls, would we have erred 

confounded with expectancy (cell A-ceU U) is p (cell 

difference obtained by jJ y,) of the treatment effects. 

A-cell B) or the nonoccurrence (cell ^ uncontroUed for expect- 

For Case 2 the normaUy confounded expen ^ ^ ^ 

ancy would have yielded a difference o • ’ ^ por Case 3, a 

tributable to treatment unconfounde ™ P unconfounded treat- 
6.0 difference, of which only half was attnbutable 
menl effect, would have been clamed. 


Interacting Treatment Effects 


iracnng ireanueu' r ps 

The three cases discussed have f j'^jTcantTn^^^^^ 

4 and 5, shown in Table 23-3, howev , ^ sources 

effects in addition to significant ® .(foots of experimental treat- 

of variance are equal in magnitude. interpretable apart from 

meat and experimenter expectancy, hence, are not interp 

the interaction effect. P a„ effect on subjects 

In Case 4 the experimental treatment has 

TABLE 23-3 


Expectancy-Controlled Experiments Showing Inter- 
acting Treatment Effects 

treatment conditions 

Exper.mentn/ Control 


Cose 

4 


Expectancy 

Occurrence 

Non occurrence 

Occurrence 

Nonoccurrence 


6.0 

0.0 

6.0 

6.0 


0.0 

0.0 

6.0 

0.0 
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significant and large, or (2) significant and small, or (3) insignificant and 
Virtually zero 

Large Treatment Effects 

Table 23-2 shows some likely hypothetical results of a complete 
expectancy-controlled experiment in which the treatment effects are signifi- 
cant statistically and large numencally The numbers in the cells represent 
the mean data obtained from the subjects m that condition For the sake 
of clanty we may assume that the mean square within cells is so small that 
any numerical differences are statistically sigmficant 


TABLE 23-2 


Expectancy-Controlled Experiments Showing Large 
Treatment Effects 


Case Expectancy 

1 Occurrence 
Nonoccurrence 

2 Occurrence 
Non occurrence 

3 Occurrence 
Nonoccurrence 


TREATMENT CONDITIONS 


Fxperfmento/ Control 

6 0 0 0 

6 0 00 

6 0 10 

5 0 00 

6 0 3 0 

3 0 0 0 


Case 1 shows that whereas the expenmental treatment had a powerful 
e ec upon subjects performance, experimenter expectancy had neither 
T enter into interaction with the experimental 

“ »• ^ reassures us that our treatment per 

effec™ “npugns the generality of experimenter expectancy 

shows almost the same magnitude of difference between the 
r'-icp ^ Un ® experimental vs control subjects as we found in 

<:nnll -i H experimenter expectancy effects were sigmficant, though 
small and trivial relative to the powerful effects of the treatment condition 

tnnf OP * ^ treatment effects, although still large and signif- 

icant, are no greater than the effects of experimenter expectancy 
Pvnpp»o ^ ^^ses, then, show increasing effects of experimenter 

pe ncy, a ough m each case we would correctly conclude that the ex- 
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Case 7 shows only a large and signifieant expectaney 
Case 1 in showing only a large main effect, but unhke Case 1 “ ^ 

omission of expeetancy controls would have caused serious error. Not oriy 

would the effect of the treatment have been ^ 

of the effect (ceU A-^ell D) would have been thought to be 6.0, as 

1. si,». . sip®-. jg 

..peclancy effect and a sfgnificant n^td have 

The omission of expectancy contro s m i ’ been 

greatly misled us as to the magmtu e o tjie experimental over 

interested only in establishing any difference /misled by the 

the control conditions, however, we would not have been m y 

omission of expectancy controls. 

Other Treatment Effects 

oaf, a ed fhe p».,b,e oa« " SSt 

ments have been presented. Some o Examples of 

detail make some sort of psycholopca sen , significant and 

those that do would be situations in w interaction, which are 

very large relative r'^Ses 1 ouLomes making less 

smaU but significant (Table 23-5). fcxampies 

table 23-5 

pretable Interacting Mam Effects 

' treatment conditions 


Case 

9 

10 


Expectancy 

Occurrence 

Nonoccurrence 

Occurrence 
Non occurrence 


Experimental Control 


6.0 

6.0 

6.0 

3.0 


3.0 
0.0 

6.0 
0.0 


... gituations in which (I) the 
psychological sense include those .gbly exceed the means of the 

means of the control means obtained under the 

experimental conditions, and/or ( ) obtained under the cxpcc 

an^for-nonoccurrence exceed „,etion of these reveled 

for-oceurrence situation, and/or ( ) outcomes are less sensi p J 
main effeets. To say that some of these 
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performance only when the experimenter expects such performance If 
this outcome were the “true” state of affairs, then the omission of the 
expectancy control groups would have been quite senous The experimental 
treatment would have been regarded as significantly effective and large m 
magmtude when, in fact, such a conclusion, unquahfied, would have been 
extremely misleading 

Similarly misleading would be conclusions based on the situation 
shown m Case 5 if expectancy control groups had not been employed In 
this case either the expenmental treatment or the experimenter’s expectancy 
was sufficient to affect the subjects’ performance in the expected direction, 
to the same degree, and without any summative effects attributable to the 
combined effects of treatment and expectancy (In Case 5 the suspicion 
might arise that a special instance of Case 3 had occurred where a low 
ceihng on the dependent variable measure had prevented a higher mean 
score from being obtained in cell A ) 

Small Treatment Effects 

In Table 23 4 we see a number of outcomes in which the effects at- 
tributable to the experimental treatment are either trivial or absent alto 
gether Case 6 shows the simplest of all outcomes Nothing made any 
difference, not the expenmental treatment, not the experimenter’s expect- 
ancy, and not the interaction This, like Case 1, is one of the few situations 
m w ch an omission of the expectancy control groups would not have m- 
creMe our errors of interpretation But as with Case 1, it seems impossible 
someone’s) ascertammg empirically 


TABLE 23-4 

Expectancy-Controlled Experiments Showing Small 
Treatment Effects 


Cose 

6 

7 

8 


Expectancy 

Occurrence 

Nonoccurrence 

Occurrence 

Nonoccurrence 

Occurrence 

Nonoccurrence 


TREATMENT CONDITIONS 


Experimental 

Control 

00 

00 

00 

00 

6 0 

6 0 

0 0 

0 0 

6 0 

5 0 

1 0 

00 
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TABLE 23-6 


Magnitude of Error as a Function of Choice of Com- 
parison 


COMPAR/SONS 


Cose 


Wi/hin Rows Within Diogono/s 

(A-B or C D) {A-D or B C) 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


00 
00 
0 0 
3 0 
30 
0 0 
0 0 
00 
1 5 
1 5 


00 
1 0 
3 0 
30 
3 0 
00 
6 0 
S 0 
1 5 
45 


treatment effect has been listed It can f ',argf 

row comparison leads to fewer errors, comparison Furthermore, 

obtained If the choice is of a «>*>" ‘>2 focc«r in the within row com- 
errors in obtaining the “true tteatraen j controlled expenment 

panson only in those cases where the compie y 

shows an interaction effect ,„i„ri, nf the two within tows com- 

It makes no systematic difference ,0 make 

pansons we choose (cells A vs B or ce make a very important 

within diagonal comparisons, g ^5 C or cells A vs 

systematic difference whether we emp y ^ always underestimates t e 

The former comparison, except for Cas , ^ompanson ol- 

“true” treatment effect, whereas the /,^ms clear, then, that 

ways overestimates the "true trea me ^ ^1,5 cxpenmenter shou 

inor any reason only two cells can be -P oyed. ^„„ence or the 

have the same expectancy m both, eiine 

nonoccurrence of the treatment e ec „,rtial expectancy-controllc ex 

Although the two-cell, within ro . agonal expenment, it is n 

periment is preferable to the , rolled expenment nor even 

substitute for the complete expectan y TT,c thrcc-ccll ‘'“'S"’ 

the three-cell design (B or C L^jmg us a replication of the us 

least, has the very real advantage ® expectancy 

expenment (cells A vs D) uncontroUed for expe 
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chologically is not to say that they will be rare The unexpected, reversed 
finding IS quite frequent m the behavioral sciences 

Adding to the hkelihood of less sensible findings are some of the data 
presented earher in this book demonstrating the “bendmg-over-backward” 
effect Although not the usual result, there are occasions (e g , when the 
rewards are psychologically excessive) when experimenters try so hard to 
avoid letting their expectancy influence their subjects that the subjects are 
influenced to respond in the direction opposite to that consistent with the 
experimenter’s expectancy If unexpected treatment effects join synergis- 
tically with an expenmenter bending over backward to avoid biasing, we 
may obtain a sigmficant “reversed interaction ” In this case, for example, 
only that cell (D) in the control condition assigned an expenmenter not 
expecting the treatment effect would show the predicted treatment effect 


Partial Expectancy Controls 

So far we have discussed only the use of “complete expectancy con- 
trols ” The use of "partial expectancy controls” (employing either of rather 
than both cells B and C) is best considered only if the alternative is to use 
no expectancy control at all The relative loss of information incurred, when 
cmly partial rather than full expectancy controls are employed, depends on 
the true” outcome of the expenment Thus, although for most outcomes 
we would be better off to use partial rather than no expectancy control, 
1 ^^tcomes involving interaction effects (e g , Cases 4, 5, and 

iU) tor which the use of only partial controls could lead to senously er- 
roneous conclusions about the relative effects of the treatments vs the 
^ ° e expenmenter’s expectancy The problem currently is that we 
if deciding what the true outcome would have been 

prnnnc f Controlled As complete expectancy control 

tinn Fn j more, we may accumulate enough informa- 

bothl nf tl!* ^ ^ study we can afford to omit one (or 

Doth ) of the expectancy controls 

emnloved^whTF/^^^^^ perhaps logistic, only two of the four cells can be 
Dansons w th ^ choice‘s We may choose either one of the com- 

wulun d.agonLTelhBvs'^C of r ^ n 

defintno th,» “triio” s c or A vs D, the “usual companson) By 

tween the column treatment effect as the difference be- 

thereIat™roTrLTo?:.Z^^^^ 

may be illustrated withm-rows vs within diagonal comparisons 

fullv "rnnlrnU^il^ derived from the hypothetical outcomes of the 

f arLn T m TrT'^ ■" Tables 23-2-23-5 For each com- 

parison. the magnitude of error m obtaining the “true” magnitude of the 
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W the e^pemneoter-s uddetlping Tpodvaoop foi ha«ng 

act with appreciation of the necessty ^/are not speaking here 

hostility at having been deceived, o e employing) decep- 

^^y^vtaSsl? ^ >n ntost detail, hy Kehnan 

[ 1965 ].) 

The Induction of Experimenter Expectancies 
Ascribing subject 

raenter expectancies calls for a sta em - gg having character- 

assigned to ceU B are de^^ri^ed to he.r ^ent^ 
istics such that their response m r oje described to their expen- 

subjects in cell A. Subjects assigne o response will be like that 

menters as having . one we have described earlier, 

of subjects in cell D. If the experimen among college students, 

the edict of anxiety upon P tS -m a bit below avemge 

cell B experimenters could be told ^ )^^^^^,nrs could be told their 

intellectually for college studen . ^ ii_„j,,aiiv. It goes without saying, 
subjects were a bit above average ® experimental conditions 

course, that subjects are assigned at random to P 

or equated on intellectual performance. 

Ascribing experimenld *rtr”ament co'nM I" 

expectancy control groups is by t e himself administer the expen 

those cases where the experimenter d ^nhiects have received the ex- 
mental treatment, he is told that t e ^^^^nts have received ™ 

perimental treatment and that ce experimenters wou 

“treatment.” In the example we “ity-arousing 

told that their subjects had . ,1,^^ subjects had not— tha y 

cell C experimenters would be to 
were part of the control group. 

. o« A third method of gener- 
Disparagement of treatment disparagement of ncat- 

ating expectancy control q experimenters are shown 

ment eflcctiveness. In this met . 
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IMPLEMENTATION OF EXPECTANCY CONTROLS 

We have discussed the general design of expectancy control groups 
but have had little to say so far about some practical issues raised by this 
methodological suggestion For example, we stated at the beginmng of this 
chapter that experimenters’ expectancies tended to be preconfounded with 
their expenmental and control conditions How can we create those condi- 
tions in which the expenmenters’ expectancy runs counter to the predicted 
effects of the expenmental conditions (cells B and C)*^ A number of meth- 
ods are available for creating expectancy control groups, and these will be 
descnbed shortly However, most of these methods involve the withholding 
of information from, and giving of false information to, the expenmenters 
A number of ethical questions are raised by such deception 


Ethical Considerations 


Perhaps the major question to ask is whether the distasteful though 
necessary deception is warranted by the potential importance of the result 
of the expectancy-controlled experiment Since virtually no scientific be- 
havioral research can be umvocally descnbed as too trivial to warrant 
a equate controls, it would seem that most research conducted in the be- 
hwioral sciences should be expectancy-controlled It is a moot question 
w et er the deception of data collectors should score lower on an evaluative 
scale than the production of research results that may be subject to senous 
enor-^rror that could be assessed by the employment of appropriate 


prni9 IS the deception of data collectors (or subjects) in gen- 

<!par('ii A placebo control groups m pharmacological re- 

that nn conducted under double-blind conditions, suggests 

decent?"? f Pl^^^bo and double'blind 

of dmp art warrant use by the greater knowledge 

mncv p? ? re^arch on expenmenter 

no^harmful t employed deception of necessity and have found 

cant H inJormanon given data coUectors 

ratcreIvco^tHTi.‘‘‘f We have found no hostihty (to 

of how exDe^taneiPd h \ h collectors resulting from an explanation 

seemed mtngned and wtde'red^X''* “"‘rary. ‘he data collectors 

employed ° expectancy controls were not routinely 

"srt ‘= t, 

the fact of deception itself but by the manner of deceiving the personahred 
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Intentional influence. A fifth method for the creation of expectancy 
control groups, and one not requiring the employment of deception, is the 

cedure foUowed by expenmenters “ ^ cmdition, but they ate told 

aware that their subjects ate in ^ ^ ,i,ey had been in the control 

.™.V — P.-*™ — 

of Wtey of cells B and C w.th cells A and 

last two ceUs are not making any intentionality of influence 

whereas experimenters in cells B “expectancy control 

is confounded with the “primary (ce 
group” (cells B and C) comparison. 

Unintentional communication. ^ ''**j,^^‘o°ftr°n'that no expectancy 

control groups differs *tom a" *ose experimenters of the expectancy con- 
is ever explicitly communicated to tti ^ „ f maintaining double- 

trol groupl This method is based on the Experimenters of 

blind contact which was documente expecting large treatment 

cells A and B are twined by expenm ^ experimenters 

effects, and experimenters of cell . ,ers serving as -trainers are 

expecting no treatment effects. municate these expectancies to t ei 

likely to subtly and unintentionally communicate 

trainee-experimenters. _ „,~.rimenters can be created by any 

The expectancies of the ^ Another method of creating 

one of several of the methods desen ' describe the experiment in w ic 
expectancies in the trainers wou e . j that cells B and C wou 
the trainees will be employed .fell A and cell D trainees 

be formed as randomly divided subp P having them actually 

Finally, expectancies may be crea e ^ experiment, e 

participate as experimenters in ce s ^ trainees, an ce 

Linei^, of cours'e, would contact only A (a 

trainers would contact only cel exrKCtancy control 

Subjects' responses. A ^""’"'feommunicatefan «pac'ancy 
groups is one that also never exp i J jj-om studies of the c 
experimenters. It is a method t a 
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the specific experimental treatment of their subjects “could not possibly” 
have the predicted effect on their behavior Cell B experimenters are 
shown” that, whereas the subjects of the treatment condition may show the 
predicted response, the subjects of the control group will show that response 
just as much if not more Thus, in the example used, cell C expenmenters 
would have pointed out to them that the particular “anxiety-arousal” 
treatment could not really make anyone anxious Cell B experimenters 
would have pointed out to them that the particular nature of the “control” 
condition was such that it might make subjects even more anxious than the 
expenmental” condition 


eory reversal. A fourth method of generating expectancy control 
^oups IS t at of hypothesis or “theory reversal ” It can best be used when 
ess aca emically advanced or less expert data collectors are employed In 
ntinT-u r ui ^ expenmenters are provided with a plausible 

that * buttressed by “earlier results” or results in the hterature 

of relativp t ^ rationale) for expecting just the opposite sort 
Imnrcrn'””'/'? expenmental and control subjecis In our 
control Situatrnn "" ^ experimenters might be shown how the usual 

generates anxiety whereas the anxiety- 
“ "• " 

ancy controf prnim!"if"^ "u '*** methods for creating expect- 

■nterested in the effec't^of investigators not specifically 

exception to be found > 1 , P*'’™"'er expectancy, there is an ingenious 
relalship between (1964) In a stud/of the 

more hypnouzable siih Rosenhan (1963) found 

to conform less under oih* ° “nder certain conditions and 

attempted to replicate “ research assistant then 

experimenter to cells A and rx '"F ^®^'"’'ally he assigned himself as an 
ployed the technique of “th nssistant to cells B and C He em- 

rcsults of his earlier study but w.'ihm'''”^'” the assistant the 

cicnts reversed ^ preceding the correlation coefli- 

sclf obtained data simdar to th"*^*^”^*^”**^** study showed that Rosenhan him- 
obtained data similar to the ^ obtained earlier, but the assistant 
sislcnt with her hypothesis Ro obtained earlier but con- 

cxpcrimenters differed in manr""°" P°‘"'s out that since the two 
concluded with great certainty^ “P^ctancy it cannot be 
led to the opposite cxpenme^l rL'', difference that 
expectancy -controlled study showed th 7 "'''“Koloss, the results of this 
expectancy) might account for some of ih'.T.r"’^"'" (including 

the literature * differences in results reported in 
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Two experimenters. If only two experimenters are available it would 
probably be best if each could contact subjects in all four conditions but 
Lme alternatives are possible and may, for a particular experiment, be 
necessary Thus, Rosenhan (1964) could not very well have p aced hmseh 
into the^B and C cells of his expectancy-controlled experiment, nor, y 
technique, placed his assistant in the A and D cells ,1.^6 

With two experimenters the four cells can be dm q ^ 

ways (1) One experimenter contacts only those “Ejects to be seen 
an expectancy for occurrence of the treatment f2) 

the other experimenter contacts the remaining su j subiects (cells 

ancy control groups (cells B and C) experimenter’s at- 

In each of these three divisions the effect of the cxperi ^ 

tributes is confounded with one of t e experimenters could 

division 1 individual differences between jj, division 2 

sigmficantly alter the magmtude of the ^ division 3 they 

these differences could affect the treatmen > usable 

could affect the interaction Divisions 1 a research, as when 

(although their analogue is sometimes ernp ^ d control con- 

different experimenters contact subjects in the treatment 

*1°“) expenmenters’ attributes 

Division 3 does seem useful If mntacted by each expen- 

are constant for the subjects of the “ sJiould be affected, although 
menter, then at least neither of the main e g,„ujfj(;ant interaction which 
their interpretation may be complicate y division, across the 

could far exceed either or both of the main e , analogous to the 

diagonals of our basic design, -VArR^enhan (1964) 
expectancy-controlled study conducte y 

1 nf exnerimenters larger 
More than two experimenters. Vor ^ would appear to be 

than two but smaller than about eight, * ^ confounding the 

either (a) using each experimenter in eac 3 _ above, or perhaps 

interaction with experimenter differences a about half the expen- 

best of all, (c) a combination of a and b 

menters available are assigned to each me ° permits a com- 

The part icular advantage of 

are not analogous to error terms m ™nu,ng on what basis was used for t 

ample may be regarded as either model depend 

selection of the experimenters experiment yield r«ults 

* If two experimenters divided the P other w 

three cells of one experimenter and t 
confounded with the experimenter 
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early data returns and the finding that experimenter expectancies may be 
altered by these early returns Half the expenmenters of cell A are, through 
the use of aecomphces, provided with disconfirming early returns, thereby 
making them more like cel! C expenmenters Half the expenmenters of 
cell D are similarly provided with disconfirming data, thereby making them 
more hke cell B expenmenters If only one expenmenter is available, we 
can then employ him in cells A and B or m cells C and D We saw earher 
that this was preferable to employing experimenters in the diagonal condi- 
tions (e g , cells A and D) 

More generally, the procedure of providing expenmenters with 
planned early returns can be employed to augment some of the methods 
descnbed earher for creating expectancy control groups Thus, if the 
“method of ascribing subject charactenstics” has been employed, the in- 
duced expectancy would be greatly strengthened by the first few subjects 
providing the expected data More details of the procedure for providing 
confirming or disconfirming early returns through the use of accomphces 
were presented in the chapter dealing with the effects of early data returns 
In our discussion of vanous methods for generating expectancy control 
groups we have tned to be suggestive rather than exhaustive Entirely 
different methods, a variety of subtypes of the methods mentioned, or com- 
binations of the several methods may be most useful for a certain area of 
behavioral research and a specific research question 


Experimenter Assignment 

Perhaps the ideal way in which to use expectancy control groups is to 
take a large and random sample of experimenters and assign them randomly 
to the vanous subcondilions of the experimental design we have been dis- 
cussing The general advantages of a large number of expenmenters have 
already been stressed m earher chapters But the absence of such a pool of 
expenmenters does not rule out the use of expectancy-controlled designs 

One experimenter. Even if only a single experimenter is available, 
expenments can be expectancy controlled Subjects m cells A and D would 
be contacted as in ordinary expenmental procedure By using certain of the 
methods descnbed earher for creating expectancies, the same expenmenter 
can also contact subjects in cells B and C If more than one expenmenter is 
ava a e, a may be employed in each experimental condition (In such a 
case the analysis of the data changes from the simple 2x2 [treatment X 
expectancy] analysis of variance to the more complex 2 X 2 X N [treat- 
ment X expectancy X experimenters] analysis m which each experimenter 
1953] = “ rephcator of the 2 X 2 expenment [e g , Lindquist, 


Lindquist (1953) or a comparable text should be 
consulted with special attention to the fact that error terms m fixed constants models 
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tensuc (eg, sex. anxiety, need tor achievement) In this case <>” basic 
2X2 dLign becomes a 2 X 2 X 2 design, assuming that the level of sub- 
lec^chmaciristic does not in itself affect expenmenters expectanc es re- 
lardine the effects of the treatment condition Our four basic groups , , 

'Q ?have become eight groups representing a proportional increase m 

complexity 

in complexity may be required y nf its effect were opposite 

treatment condition if the preexisting jiustration we return to our 

to that of the original treatment ^ perform- 

example of a study of the effects of anxie y which subiects are 

ance Suppose we add an expenmenta •phe hypothesis 

actively reassured about their intellec ua p performance 

might be that this group of subjects *0“ j^^^as die anxious subjects 
relative to the “no-treatment” contro gr p, condibons or 

would show an impairment We we have employed in 

levels of expenmenter expectancy rath become not a 

earher examples If we did, our basic tJierefore, have become 

2 X 3 but rather a 3 X 3 Our four basic groups, there! 

mne groups y , entertain such a complex 

For logistic reasons we may not be an p^iaj 

design If this is the case, then what we h ^sai^^^ 
expectancy controls will apply There or , j,y experimenters 

groups of our design, all three groups j ^ within-row comparison 

holding the same expectancy This wou ^ , -evl diagonal companson 

rather than the fully uncontrolled ( ™ ® P completely with expenmental 
in which expectancy would be confounded completely 

condition , principle of expectancy 

In any specific experimental situa on , specific form of the 

control can be apphed by the investip - ,]jg researeh question an 

design will be determined both by the na jesearch 

by consideration of the resources available for 

CONTROLLING FOR SUBJECT EXPECTAN 

, special control groups to 

In this chapter we have discussed in an earlier chapter, 

control only the effects of experimenter ® P Jg„,al situations, the su 

however, we showed that, at least in could also be uninten e 

jects’ expectancies or outcome onen a i ^ ^ modeling effects 


s or outcome onentations ^ 

» The control of other pe„"ds on"heir "'^""Tde'ahng with 

due to various other bee" discussed m th 


the control ot oiner expc** 
due to various other experimenter 
00 their expenmental induction, t 
the sampling of experimenters 
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panson of the results of the two strategies Using the results of the rephca- 
tion(s) m which each experimenter functions m all four cells (strategy a) 
may help us assess whether a large interaction in the results of a rephcation 
employing strategy b is due to confounding with experimenters or is more 
likely to be independent of experimenters With a small number of experi- 
menters, however, we can never answer that question with great confidence 
because we will not be able to assess adequately the effects of the orders 
and sequences in which experimenters contacted the subjects of the different 
treatment conditions (cells) 


More than seven experimenters. If we have eight or more experi- 
menters available, we can begin to think seriously of assigning them at 
random to one of the four cells of our basic design, thereby eliminating the 
problem of assessing order and sequence effects ® It also becomes more pos- 
sible to test the significance of the difference m results obtained by expen- 
menters within treatments as well as the effects of the treatment condition, 
the expectancy condition, and their interaction If the use of such a “nested ’ 
(Winer, 1962) or groups within treatments (Lindquist, 1953) analysis 
shows no significant individual differences between experimenters within 
cells, we can simply forget that the subjects were contacted by different 
data collectors and use the individual differences among subjects within 
cells as the error term against which to evaluate the other sources of varia- 
tion Or with samples of experimenters very large, the mean scores ob- 
tained by each experimenter may be used as the basic data which can be 
analyzed by the standard 2X2 analysis of variance 


More Complex Designs 

Throughout the discussion of expectancy control groups we have kept 
t e asic design as simple as possible for illustrative purposes Thus, our 
asic expenment has been the comparison of a single expenmental treat- 
ment condition with a control condition The pnnciple of expectancy control 
poups can, however be applied to more complex designs In some situa 
tions the complexity of the expectancy controlled design increases pro- 
po lona y to the complexity of the added expenmental groups In other 
SI ua ions, owever, the increase m complexity is disproportional 


Proportional increase in complexity. As an example of a proportional 
increase in comp exity, we note that the simple complete expectancy-con- 
trolled expenment (2 X 2) may be subdivided into two subexpenments, 
eac conducted with subjects at one of two levels of some personal charac- 

the ‘J T '» 

menten; With ran/ln onfoundcd with individual differences among expen 

Sid TeS Iff a'l.JnH experimenters to cells this confounding is less 

and less of a problem as our sample of experimenters becomes larger and larger 
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We can, therefore, assess the indepe interactions between any two 

jeets’ and the expenmenters’ ^tto 

of these independent variables, and t e in er ^ 

If all eight groups could not be 23-7 Then aU 

half by employing any two rows o jhe 

expenmenters (rows 1 and 2) or none rows 3 and 
effects of alcohol Or all subjects (rows subdivisions would 

■would expect the effects of alcohol ny , effects of expen- 

be helpful, but none would permit a rows in which 

menter vs subject expectancy However, ^ , rvs 2 and 3) would 

experimenters’ and subjects’ expectancies disagreed (row 

permit such a comparison nermit ceneraUzanon to the 

If the purpose of the expenment were ^ ^ ^„„,o,ned, rather 

real-hfe social dnnking situations in w verbal learning, we would 

than to evaluate the effects of a chemic P subjects’ and expen- 

prefer that subdivision of the expenmen ^ ‘and 4) In most teal life 

menters’ expectancies were in agreeme t “evaluator” are aware of 

social dnnking situations both the dti er a certainly exceptions 

whether alcohol has been consumed, “yf/^anment does not permit 
to this Employing this subdivision o e ^ j.g» expectancies How- 

us to compL ^effects of subjects’ or “F"" Jennie purposes, 
ever, we may be less interested m that P ubdivision Another 

sacnficing it L the greater .* 0^0 replicate of the “usual 

advantage of this subdivision is th 

experunent (cell A vs cell D) . . ^ of the eight groups, we 

If, for some reason, we couldemploy only we have equated for 
may choose any one of the four On the grounds 0 

both subjects’ and expenmenters e*P prefer row 1 or row 4 0 
logical vahdity, however, we would pro ^pjement practically, we g 

2 or 3 And because it might be ea-r to JPlej P ^ be chosen from 

prefer row 1 over row 4 For any ..pp would be made on bases 

the full complement of eight groups. section dealing 

Similar to those presented just now an 

parUal expectancy controls have 

ni goes wilhou. sayin, tUa. a..^ 
volunteered to ingest alcohol, though with the un 
iiftccssarily receive alcohol 
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termmants of the results of our research There may be some expenments 
m which these subject expectancy effects are large and perhaps as important 
as, or even more important than, expenmenter expectancy effects By em- 
ploying the principles for generating expenmenter expectancy control 
groups we can control for subjects’ expectancy We can illustrate this best 
by imagining the following expenment 

We want to learn the effects of alcohol on verbal learning Our basic 
design IS to have half our randomly assigned subjects consume a given 
quantity of beverage alcohol while the remaining subjects consume a soft 
dnnk For the sake of simphcity let us suppose that expenmenters and 
subjects ahke are convinced that the ingestion of the experimental dosage 
of alcohol will impair verbal learning We can control for expenmenter 
expectancy by having expenmenters beheve that half the subjects in the 
treatment (alcohol) condition are in the control (soft-drink) condition 
(cell C) Similarly we could have expenmenters in the control condition 
believe that half of their subjects are in the expenmental condition (cell 
B) So far we have dealt only with our old fnends cells A, B, C, and D 

Because subjects beheve strongly (let’s say) that alcohol impairs their 
verbal learning, our old A, B, C, D design is confounded by subjects’ 
expectancies Table 23-7 shows the situation In our old cell A, subjects 

TABLE 23-7 


Double Confounding of Treatments with Experimen- 
ter and Subject Expectancy 


EXPECTANCY 


TREATMENT 

CONDITIONS 

Experimenter 

Sufc]ecf 

Row 

Experimental Control 

Occurrence 

Occurrence 

1 

A B’ 

Nonoccurrence 

2 

A' B 

Nonoccurrence 

Occurrence 

3 

C D' 

Nonoccurrence 

4 

C' D 


expect the effects of alcohol, but in cell B they do not In our old cell D, 
subjects expect no effects of alcohol, but m cell C they do Our basic expen- 
ment of alcohol vs soft-dnnk has been doubly confounded If we used only 
the basic groups of cell A vs cell D. any differences might be due to the 
effect of alcohol, the effect of expenmenter expectancies, the effect of subject 
expectancies, or any of several possible interaction effects 

To control fuUy for subject expectancy we must add cells AS BS CS 
and D^, as shown in Table 23-7 These cells may, for this hypothetical 
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.pendents, the 

Ta; jrrohtL a .0. accuse 

effectsofexpectancybiasasitoccursm real data collecto y 

both types of expectancy to operate joint y ^ 

In addition to the combination ^VZre method of 

ancy effects already mentioned we ‘"'8 P ji,eir subjects Their 

observing experimenters’ behavior in dependent vanable 

behavior vis-a-vis their subjects coul g various condiUons to 

for one analysis If we found '"Zo„ld feel more confident 

show no significant differences in e a , found significant differ- 

in the subsLtive results of the “P^"f ""-I'**””’ 
ences in the behavior of experimen ^^otrol condi- 

feel more confident that our trouble ““'”2 J ^ their subjects 

tions was warranted The expenmen “ jj choose to so regard 

can also be regarded as an indepen en about methodological mat- 

it, then we will learn something more, no ^ ^ interpersonal mfiu- 

ters but about some substantive issues 
ence as well 

T^nnrc. roST VERSUS UTILITY 
EXPECTANCY CONTROLS. COM 

, . exnectancy control groups we can 

In assessing the employment P weighed one type 

weigh their cost against their utility e information to our 

cost — the need to withhold informa ion ^ _ for expenmenter ex 

data collectors In general, the f s 

pectancy seems to outweigh heavi y control croups 

by most methods of generating expectan y required for an e - 

What about other eosts^ The number of sub,^^^ nd, 

penment is not increased, the time P^ ® ' involved is not even 

sometimes, the number of data additional time in the p 

The creation of expectancy control gro p jimenters are erap oye , 

ning stages of the experiment and, i m measured m j 

the traiLg stage But this °L SorZh°“''> P^°"" v Xo 

minutes, not in months and weeks, an employed there "’“J 

obstacle It a larger number of experi experiment no 

be a small increase in the finT^V'^use an experimenter employed Jor 

more hours are involved in all, but e ,|,an one e p 

a total of one hour must usually be P®' , j^all “ 

tor 50 hours But this cost, too, is re 1 ^^p^vi 

“Not really a cost but a foTc 'the''m“°' “““'ecs of 

ancy controls should be made «P'>e'' ^s Se too long before the 
sonal commun, cation (1965). it might not 
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COMBINING METHODS OF CONTROL 

The control group designs descnbed in this chapter can be combined 
with other methods for the control of experimenter effects which were 
descnbed in earher chapters We can, for example, minimize the contact 
between experimenters and subjects of expectancy-controlled experiments 
This should reduce the communication of our experimenters’ expectancy to 
their subjects, but unless we have an intrinsic interest in these expectancy 
efiects, that is all to the good As contact with subjects is reduced further 
and further, m pnnciple we have less and less need for the employment of 
any expectancy controls at all 

Combining of mimmized (or blind) contact with expectancy control 
groups has a very special advantage It provides us with an opportunity to 
assess the success of the minimization (or bhndness) of contact If contact 
has been successfully minimal (and/or blind), we should find no significant 
main effect of experimenter expectancies nor any interaction involving ex- 
penmenter expectancy Finding such effects would be sufficient evidence 
for concluding that the minimization (or blind) procedure had been in- 
effective 

A still more powerful combination of controls for expectancy effects 
might include samphng experimenters, determimng their expectancies, ap- 
plying the expectancy control group procedure, and maintaining blind and 
minimized contact This combination of controls might reduce to an abso- 
lute minimum the biasing effect of experimenters’ expectancies The basic 
2X2 design descnbed in this chapter could then be extended into a third 
dimension — the dimension of “idiosyncratic” or “natural” expectancy If 
there were only two types of idiosyncratic expectancies, our overall design 
might become a 2 X 2 X 2 arrangement — the experimental vs control 
treatment, the experimenters led to expect a treatment effect vs those led to 
expect no treatment effect, and experimenters “naturally” expecting a 
treatment effect vs those expecting no treatment effect If we had a range of 
idiosyncratic or “natural ’ expectancies rather than only two, we could 
elongate the design to have three, four, or even more levels of “natural” 
expectancy 

One advantage of generating this third dimension of experimenters’ 
natural expectancies is that it may help to reduce the variation between 
expenmenters (within cells) Within any one of the basic four cells of our 
expectancy-controlled expenment, expenmenters’ obtained data may vary 
because of variation in initial idiosyncraUc expectancies 

Another advantage of generating the dimension of expenmenters’ idio- 
syncratic expectancies stems from the finding that expectancy bias is maxi- 
mized when experimentally induced and idiosyncratic expectancies are m 
agreement (Rosenthal, Persinger, Vikan-Kline, & Mulry, 1963) In “real” 
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The socxal situaUon that comes 
counters his research subject is one of both genet 

to the social sciences Its general interactions, 

interaction of experunenter and subject, hk us mote about 

may be mvestigated empirically with a from the fact 

dyadic interaction in general unlike other dyadic mter- 

that the interaction of experimenter and s j , sciences 

actions, IS a major source of our knowledge i ^j^jgo ,n the social 

To the exient that we hope for ab^ut the expen- 

sciences generaUy, we must ^P“^ uan no mire hope to acquire 
menter-subject interaction specifically understanding of the 

accurate information for our disciphnes zooloasts could hope to 

data collection situation than astronomers „,(hout their understand- 
acquire accurate information for their discip ‘ these reasons, 

ing the effects of their telescopes and uf the experimenter- 

increasing mterest has been shown in the rave 6 bleak It does 

subject interaction system And the out oo i experimenter 

seem that we can profitably learn »£ 

unwittingly may have on the results of s r have been put foi^vard 

In the last five chapters, a vanety of sugg experimenter in 

which show some promise as controls for the an-— In Tabic 24-1 
general and for the effects of his or techniques For each 

these suggestions are summanzed as ten s . and for the last three, 
one, the consequences of its 94,2 24-3, and 24-4 

ndditional brief summanes are shown m n 


I® SOCIAL PSYCHOLOGY OF 

^unintentional influence 

of research on ex- 

Quite apart from the methodologicanmphaations^ 

pcrimentcr expectancy effects there are 
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If a larger number of expenmenters is employed than would normally 
be the case, an additional utility can be achieved if the procedure of simul- 
taneous experimenter-subject contacts is employed, as suggested in the last 
chapter The total time from beginmng to end of the data collection can be 
greatly reduced, and this is an efficiency that is not hard to appreciate 

All in all, the total costs of conducting expectancy-controlled expen- 
ments seem tnvial in relation to the utihty of the method But it can be 
said that costs are easier to assess than utility Utility for whom? Are there 
not areas m the behavioral sciences that just do not require controls for 
expenmenter expectancy? To this it must be said that there may be, but we 
don’t know that to be the case And if it is the case, we don’t know which 
areas are the immune ones The employment of expectancy-controlling de- 
signs IS perhaps the only way in which we can find out In a sense, we must 
use these controls to learn whether we can afford to do without them 

research assistants are exhausted tn the sense that in these circles everyone would 
^ow all about expectancy controls In that case less sophisticated experimenters must 
be employed though they will not indefinitely stay unsophisticated It is for these 
reasons especially that serious consideration should be given in the near future to the 
development of the new profession of data collector described earlier 
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Blind Contact as a Control for Expectancy Effects 


A. Sources of breakdown of blindness 

1. Principal investigator 

2 Subject ("side effects”) 

B. Procedures facilitating maintenance of blindness 

1 The "total blind” procedure 

2. Avoiding feedback from the principal investigator 

3 Avoiding feedback from the subject 


TABLE 24-3 


con,„. .. . c..„oi 1.. 

Effects 

A Automated data collection systems 
1 Written instructions 
2. Tape-recorded instructions 

3 Filmed instructions 

4 Televised instructions 

5 Telephoned instructions 

B. Restricting unintended -^^V^wet sute" tnd 

1 Interposing screen between 

experimenter experimenter 

2 Contacting fewer responses 

3 Having subjects or machines study 

A great deal of effort withm social P^f ^on! persuasion, coercion, 
of such intentional influence processes as educa P ^ nv 

propaganda, and psychotherapy In f ‘ ,nd the message is nsua y 
tends to influence the recipient of his m g understand th 

encoded hnguisticaUy Without ”®nded to understand the prM- 

processesbefter, greater effort should be exp»^ , en^d 

esses of unintentional influence people "talk 1 ° 

nonlinguistically The question, in s o , 

other without “speaking ” , l^now the specific sig 

At the present time we not only dojnot^^_^^^ usen know 

ihich 1 --I.nn! 


••J 51 

without “speaking not know tne sp^" . , 

At the present time we not f^uruher, we do not men know 

1 people unintentionally influenc ^uuse, thoug , 

all the nbnnnnK nf communication involved 
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TABLE 24-1 


Strategies for the Control of Experimenter Expect- 
ancy Effects 

1. Increasing the number of experimenters: 

decreases learning of influence techniques 
helps to maintain blindness 
minimizes effects of early data returns 
increases generality of results 
randomizes expectonctes 

permits the method of collaborative disagreement 
permits statistical correction of expectancy effects 

2. Observing the behavior of experimenters: 

sometimes reduces expectancy effects 

permits correction for unprogrammed behavior 

facilitates greater standardization of experimenter behavior 

3. Analyzing experiments for order effects: 

permits inference about chonges in experimenter behavior 

4. Analyzing experiments for computational errors: 

permits inference about expectancy effects 

5. Developing selection procedures: 

permits prediction of expectancy effects 

6. Developing troining procedures: 

permits prediction of expectancy effects 

7. Developing a new profession of psychological experimenter: 

maximizes applicability of controls for expectancy effects 
reduces motivationol bases for expectancy effects 

8. Maintaining blind contact: 

minimizes expectancy effects {see Table 24-2) 

9. Minimizing experimenter-subject contact: 

minimizes expectancy effects (see Table 24-3) 

10. Employing expectancy control groups: 

permits assessment of expectancy effects (see Table 24*4) 

study of interpersonal relationships. Perhaps the most compelling and most 
general implication is that people can engage in highly effective and influ- 
ential unprogrammed and unintended communication with one another and 
that this process of unintentional influence can be investigated experi- 
mentally. 
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Twelve hospitalized psychiatric patients served as “experimenters.’ On 
the basis of their scores on the appropriate MMPI scales three were 
classified as schizophrenic, three were classified as paranoid, three as chin 
acter disorders, and three as neurotics. Each “expemnenter "tered 
the standard photo-rating task to male and femde pahe^. ^ ” 

each of the same four diagnostic categones. All subjects were acu y 
rate than chronically disturbed. From half the subjects 
te dijiostic groups! experimenters were led to expect pho o ratings of 
suecess and from half they were led to expect ratmgs of failure 
It wTs somewhat surprising to find, even with 
experimenters and of subjects, that overaU “P^‘=‘“X;®“^\hersubtes 
cant. Nine of the 12 experimenters obtained 

which were in the direction of then expK an (p ’ ^^ected 

of all subjects gave ratings in the direction tne p 

(p = .002. x= = 9.05). Magnitude of " Xct, or sex of 

direcUytothe nosology of the expenmeiiter, noso analysis 

the subject, though there were ,l,at may be Ulustrative 

of the data is not yet completed, but there B Amone the psychotic 

of the type of information such researc influence on schizo- 

subjects, experimenters exerted greater um ... j,ut they exerted 

philnic’sul^ects if they were themselves sctoo^hremc.^te^ 

less unintentional influence on paranoi „Ljimenters exerted greater 

(p < .10). Among nonpsychot c subject experiment 

influence on neurotic subjects if they w jj^orders if they themselves 
exerted less influence on subjects with character disorders y 

table 24-5 


Similarity of Experimenter's 
as Determinant of Expectancy 
Subjects 


Sut/ect’s Diagnosis 

Schizophrenic 

Paranoid 


EXPERIMENTER'S 

diagnosis 

Different 


Difference 


Difference 


P < .10 two-tail 
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TABLE 24-4 


Procedures for Generating Experimenter Expect- 
ancies 

1 Ascribing sub[ect characteristics 

2 Ascribing experimental conditions 

3 Disparagement of treatment effectiveness 

4 Theory reversal 

5 Intentional influence 

6 Unintentional communication 
7. Early data returns 


optimistic There appears to be a great current increase of interest m non- 
linguistic behavior as it may have relevance for human commumcation 
(e g , Sebeok, Hayes, & Bateson, 1964) Most interest seems to have been 
centered m the auditory and visual channels of communication, and those 
are the channels investigated in the present research program Other sense 
modalities will bear investigation, however 

For example, Geldard (1960) has brought into focus the role of the 
skin senses in human communication and has presented evidence that the 
skm may be sensitive to human speech Even when the sense modahty in- 
volved IS the auditory, it need not be only speech and speech-related stimuli 
to which the ear IS sensitive Kellogg (1962) and Rice and Feinstein (1965) 
have shown that at least among blind humans, audition can provide a sur- 
prising amount of information about the environment Employing a tech- 
mque of echo ranging, Kellogg’s subjects were able to assess accurately the 
mstance, size, and composition of various external objects The implications 
or interpersonal communication of these senses and of olfaction or of even 
less commonly discussed modaUties (e g , Ravitz, 1950, Ravitz, 1952) are 
not yet c ear but are worthy of more intensive investigation 

Since expectancies of another person’s behavior seem often to be com- 
municated to that person umntentionally, the basic expenmental paradigm 
employed m our research program might be employed even if the interest 
were not m expectancy effects per se Thus if we were interested in unm- 
en ona communication among different groups of psychiatric patients, 
some cou e given expectancies for others’ behavior Effectiveness of 
unmtentional influence could then be measured by the degree to which 
other patients were influenced by expectancies held of their behavior There 
might be therapeutic as weU as theoretical significance to knowing what 
kind of psychiatric patients were most successful m the unintentional influ- 
ence of other psychiatnc patients The foUowmg experiment is relevant and 
was conducted with Chfford Knutson and Gordon Persmger 
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Perhaps success as an unintentional influencer of another s behavi 
also has relevance for the selection of psychotherapists to work 
tvnes of patients. The general strategy of trying to fit the therapist to the 
Sient” has been employed with considerable success and has arous 
Lsiderable interest (e.g.!Betz. 1962). That 

on the basis of unintentional communication patterns may also 

in one recent accept 

out, the degree of hostility found in the frohoL fo 

nificantly '‘"d 'legaUvely related to his^ ^oLm, Blane. 

seek treatment (r = —.65, p — .uo, iwo-iau i 
Chafetz, & Wolf, 1965]). 


EXPECTANCY EFFECTS IN EVERYDAY LIFE 

The concept of '’“ 950 . ‘'Sy mst R^ter, 1954^, 

psychological theorists (e.g., has reviewed the role of expectancy 

Tolman, 1932), and Goldstein ( 'p^„„,ancy as a determinant of 
as a construct of interest to psychologi . P learning the 

behavior has most often been investiga ® determine his own subse- 
extent to which an individual’s expectancy g . j tj^is book has 
quent behavior. The construct of for us, has concerned 

been more specifically interpersonal. '' of another’s behavior might 
the extent to which one person s ex^ctancy 

serve as determinant of that other s be . f others will be- 

In everyday life people do have “P^‘' experience, direct or 

have. These expectations usually are as cnientist and layman seem 
indirect, with those other people s e ' based on past behavior, 
agreed that predictions of future no behavioral sciences. 

If this assumption were untenable there w could only be 

past behavior were unrelated to future e . ’savior, not the scientist s. 
the humanist’s interest to prompt us to J „ do they influence 

But if expectations are only based upon history 

future events? intinns disconfirmed, though a 

It is unpleasant to have one s ®*P^^ need not lead to 

is not alv/ays the case. An unexpecte m expectations con rmc 

feeUngs. But often it is more pleasant to experiments ‘ 

than disconfirmed. The evidence for * ^ , jj ,^5 “expecter” . 

the expectancy is of an event that will b^“.“^, 3 dnger, 1957; Harvey & 
Carlsmith, 1962; Carlsmith & Aronsmi, ,0 behave 

Clapp, 1965; Sampson & Sibley, ^boufwhat will befall hi 

in such a way as to confirm his expect y 
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had been diagnosed as character disorders (p < 10) Tables 24-5 and 24-6 
show the magnitudes of expectancy effects for each of these combinations 
of expenmenter and subject nosology Scores for expectancy effects were 
defined m the usual manner — i e , mean ratings obtained from subjects from 
whom positive (+5) ratings were expected minus the mean ratings ob- 
tamed from subjects from whom negative (—5) ratings were expected To 
summarize these preliminary results we might say that schizophremc and 
neurotic patients are best ‘talked to” by patients of their own diagnostic 
category, whereas paranoid and character disorder patients are least well 
“talked to” by patients of their own diagnostic category Of the four diag- 

TABLE 24-6 


Similarity of Experimenter's and Subject's Diagnosis 
as Determinant of Expectancy Effects* Nonpsychotic 
Subjects 


EXPERIMENTER'S 

DIAGNOSIS 


Subject's Diagnosis 

Same 

Different 

Difference 

Neurotic 

+3 67 

+0 07 

+3 60 

Character disorder 

+0 53 

+1 81 

-1 28 

Difference 

+3 14 

-1 74 

+4 88* 


* P < to two-ta 1 


nostic groups it is the schizophrenic and neurotic patients who show the 
greatest egree of overt anxiety and who, perhaps, feel best understood by 
influencers The paranoid and character disorder patients, 
both charactenzed by more overt hostility may be especially sensitive to 
an resistant to the hostility of their paranoid and character-disordered 
influencers 

Findings of the kind described may have implications tor the inter 
personal treatment of psychiatnc disorders The belief is increasing that an 
important source of informal treatment is the association with other pa- 
tients If, as seems likely, such treatment is more unintentional than inten 
tional, then the grouping of patients might be arranged so that patients are 
put into contact with those other patients with whom they can ‘talk” best, 
even if this ‘ talk” be nonhnguistic 
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healer’s expectation of his patient’s course in treatment may be com- 
municated to his patient with subsequent effects on the course of the treat- 
Tn” Goldstein fl962) has given us an excellent picture of what ts now 
known and how much there is yet to be learned m this 

In the field of vocational rehabilitation, the staff of the Human interac 
tion Research Ins ilute concluded that the expectancies of the staff seemed 
He^ to _surate client performance They evaluated a^pmjeid^t^^^ 
attempted to demonstrate that mentally retar e ^ ^ to 

be gainfully employed. “The staff found ‘hat when th^ cS, Dorcus, 

assume some personal responsibility, he was able to do so (Cottey, 

Glaser, Greening, Marks, & Sarason, 1964, P- “ 1. has im- 

The effect of one person’s “y. “ 

portant implications for public policy, n ei and Colfins (1952) 

integrated vs. segregated housing pattern , „ pig tend 

discussed the social standards of ^ expectations of others in a 

to behave as they are expected to be av . in,_n-tant to the individual, 
social situation, particularly if these ot ^ 588 ). This does not 

help to define what is the appropriate e “^v ^hich 

surprise social scientists. But what !"'6 ® be implicit yet clearly 

the arbitrary definition of “appropriate ^hese defini- 

discernable in social interaction by the person who wouio 
tions serve as a guide to behavior. nrecedes him through the 

In the educational system a child sreput eventual 

succession of classrooms leading from s , . , reputation itself 
graduation. We need to learn the exten ^^hool. If a 

serves as the definition for the child of performs brighUy, we 

bright child earns a reputation as rig , • (.yid in some not-at-all 
consider that all is going well. But w at 1 teachers’ perception o 

impossible way earns a reputaUon as • duller behavior than 

him and their expectations of his behavior bright, is treated as 

need be the case? Or if a duller <=h'W- ^Pf „i,fhn then, in fact, 
bright in the communication system w question shortly, 

tend to become more bright? We shall re j jjqp pf one’s expectancy 

The complexity and subtlety of the reference to that 

of another’s behavior to that other is y'® transmitted from the expen 
experiment in which expectancy effects ^iect (Rosenthal, 

menter through his research assistant o experiment that in 

Vikan-Kline, & Mulry, 1963). It 0PP“'®^J arch assistant there was a 
two-person interaction between subjec a nonpresent ^ 

nonpresent third party, the primary ®*Py tbe research assistant a 

appeared to communicate his expectancy through ^ himsrif. 

without having simply made the assis an jpr the nonpresen 1 

The research assistant, while serving as jo an additive manne 

fluencer, was still able to exert his own 
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how he will act (Aronson, Carlsmith, & Darley, 1963) It seems to be not 
too great an extension to think that if one’s expectancy is not of one’s own 
behavior but of another’s, one will also behave m such a way as to influence 
that other to behave in an expected way Whatever its basis, whether to 
achieve greater cognitive order, stability, predictabihty, or to maintain cog- 
nitive consonance (Festinger, 1957), there appears to be a motive to fulfill 
one’s interpersonal expectancy 

Interpersonal expectancies in everyday life are likely to be accurate 
predictors of another’s behavior for two reasons The first reason is that 
expectancies are often realistic and veridical — i e , based on prior experi- 
ence with the other’s behavior The second reason is that, other things being 
equal, we may behave in such a way as to bring about the accuracy of our 
interpersonal expectations If we expect a person to be fnendly, it may be 
“true” because we have expenenced him as friendly, or a credible source 
claims to have expenenced him as fnendly (Kelley, 1949) In addition to 
this expenence-denved component, however, there is the self-fulfilling 
prophecy component Expecting him to be fnendly, we may behave in a 
more friendly fashion and, therefore, evoke a more friendly response 

The fact that there appear to be two components to the accuracy of 
mterpersonal predictions, hypotheses, or expectations has imphcations for 
research methods m expectancy effects If we simply ascertain people’s ex- 
pectations of others’ behavior and correlate these with the others’ subsequent 
behavior, the two components of experiential accuracy and self-fulfilling 
accuracy will be confounded If we take the appropnate safeguards, how- 
ever, we can eliminate the self-fulfilling accuracy component (as in asking 
people to “predict” behavior that has already occurred) We can also 
randomize the experiential accuracy component by “assigning” expectancies 
at random, and that is the strategy adopted in much of the research de- 
scnbed in this book What we do not yet know, and what is worth the learn- 
ing, IS the magnitude of expectancy effects, of the self-fulfilling type, in 
important everyday social interactions 

The experimenter-subject dyad may profitably be viewed as a social 
innuence system different from, but yet similar to, other social influence 
pstcms It seems most fruitful at the present time to emphasize the simi- 
ianly and to make the working assumption that the principles governing the 
uninlentiona influence processes of the experimenter-subject dyad are not 
1 crcnt rom those governing influence processes of the more commonly 
investigated type The experimental approach to the study of unintended 
social influence process can be extended from the special setting of the 
scienufic expenment to other such special settings as psychotherapy, and to 
such more general settings as the classroom, industry, and government 

t oug we might prefer a more experimental demonstration of the 
phenomenon, a number of research investigators and practicing chnicians 
have called attention to the process whereby a psychotherapist’s or other 
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the end of the school year the children were retested with the same group 

‘“‘'“’fhe'anaSsis of the data is not complete, but some of the results can 
be given Tab/e 24-7 shows the excess of IQ points gmned m class by 

fCw » 1 « IQ pome Oil .b~ -.o 1- 

TABLE 24—7 

Teacher 

mental over Control Groups (after eight months) 


Grodes 

1 

2 

3 

4 

5 

6 


INITIAL ABILITY LEVEL 

Higher Average Lower 

+11 2 
+18 2*** 

-4 3 
00 
-0 5 
-1 3 


+9 6 
-2 9 
+9 1 
+0 2 
t 

+1 2 


Weighted means +3 6 +4 6 


+24 8*" 
+6 1 
-6 3 
+9 0 
+1 2 
-0 5 

+2 8 


Weighted Means 

+ 15 4*** 

+9 5* 

-0 0 
+3 4 
-0 0 
-0 7 

+3 8* 


* p < 02 one toil 
** p < 006 one toil 
^ p < 002 one toil 


this class 


*** p < 002 one tail 

nnhers expected them 

For the 18 classes combined, those grater gam m IQ 

to gam in performance showed a signi c eac 

the control children, though the ^ difference m the “PP'^'' ,o 

ers’ expectancies, it turned out, ma . ^ First graders puip 

But at the lower levels the effects were did the control children, and 

be bloomers gained 15 4 IQ points 74 g points In the second 

the mean relative gam in one with one of the classes s 

grade, the relative gam was 9 5 IQ po > ^ especially surpnsmg 
a mean gam of 18 2 points These [ ^up, which had to 

of the large gams in IQ made by ‘he^fJ^^'ders m the control poup 
passed by the expenmental groups T o ^ gained by the e p 

gamed 12 0 IQ points (compared to tn 
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the influence of the nonpresent participant This interpersonal influence, 
once-removed, is no all-or-none phenomenon The more a person is able to 
influence others subtly, the more effectively he is able to make other people 
earners of his subtle, unplanned influence How far this chain of subtle inter- 
personal influence can extend, compheating itself at each hnk, is not known, 
nor IS the pattern of interpersonal commumcation of which the chain is 
woven But these unknowns lead to fascinating practical and theoretical 
questions of the extent of interpersonal influence, once-removed Some of 
the more obvious ones include 

When the senior psychotherapist or physician beheves the more junior 
healer’s patient to have a good or poor prognosis, is the “assessment,” 
whether exphcit or imphcit, really only an assessment‘s Or is it really a 
prophecy which stands a chance of being self-fulfilled'^ 

When the master teacher or school pnncipal believes a junior teacher’s 
pupils to be fast learners, or believes a special group of pupils to be slow 
learners, is this behef (well founded or not, and verbahzed or not) likely 
to accelerate or decelerate these pupils* educational progress'^ 

Similarly, will the expectancies of performance, explicit or implicit, of 
civihan and government employers, mibtary commanders, athletic coaches, 
and symphony orchestra conductors be transmitted ultimately to the em- 
ployees, the troops, the athletes, and the musicians with a consequent effect 
on their performance‘s 


THE LAST EXPERIMENT 

th ^ book primarily about, and of, research It seems appropriate, 

^ t description of one more experiment Several 

es now t ere has been mention of the possibihty that teachers’ expect- 
ncies o t eir pupils ability might in fact be a partial determinant of those 
TarnKc/f 'tv! experiment to be described was conducted with Lenore 
tht> ? f e procedure was basically the same as in the expenments on 
the effects of the expenmenter s expectancy 

verhnl^clrnl^f children in an elementary school were administered a non- 
nredirf^ H o ^utelligence which was disguised as a test that would 
Iv 1 were 18 classes, 3 at each of all 6 
1 grade levels one of the classes was of above 

n til H ^ ^ ‘ Tu’f ®®^oud class was of average ability children, and 
a third class was of below average ability children A table of random 
numbers was employed to assign about 20 percent of the children in each 
of the 18 classes to the experiraental condition Each teacher was given the 
names of these chUdren “who would show unusual academic development” 
dunng the coming school year That was the experimental manipulation At 
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inputs into the experimenter-subject interaction could be so relatively easily 
controlled and observed, we should not expect a quick or an easy solution. 
But there may be some consolation drawn from the conviction that, at least, 
the problem is worth the effort. 
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mentals) and second graders gained 7 0 IQ points (compared to the 16 5 
points gained by the expenmentals), somewhat larger than might simply 
be asenbed to practice effects It is possible that the entire school was 
affected to some degree by being involved in an expenment with consequent 
good effects on the children’s performance 

It was somewhat reassunng to find that the gams made by the experi- 
mental group children were not made at the expense of the control group 
children In fact, the greater the gam made by the experimental group 
children, the greater the gam made by the control group children m the 
same class The rank correlation between gams made by the experimental 
and control children for the 17 classes that could be compared was + 57 
(p z= 02, two-tail) 


The teachers had themselves adimmstered the group IQ posttests, so 
that the question arose whether the gain m IQ of the expenmental group 
might be due to differential behavior of the teacher toward these children 
during the testing Three of the classes were retested by a school adminis- 
trator not attached to the particular school employed She did not know 
which of the children were in the experimental conditions On the average 
the results of her testing showed somewhat greater effects of the teachers’ 
expectancies In the class in which the expenmental group children had 
earned a 25 IQ point gam m excess of the control group children’s gain, 
the expenmental group children showed an additional 8 IQ point gam 
when retested by the ‘ blind” examiner It seems unlikely, then, that the IQ 
gains are attnbutable only to an examiner effect of the teacher 

That teacher expectancy effects should be more pronounced at the 
lower grades makes good sense In the lower grades the children have not 
yet acquired those reputations that become so difficult to change m the 
later grades and which give teachers in subsequent grades the expectancies 
^ ® performance With every successive grade it would be more 

difficult to change the child’s reputation The magnitude of expectancy 
effect showed a fairly regular decline from first to sixth grade (rho = -f 83, 
p = 05, two-tail) ^ 

There are important substantive implications for educational practice 
m e resu is of this expenment In addition there are important methodo- 
ogica imp icauons for the design of experiments in education which seek 
^ if K ^ ^ of various new educational practices Such implica- 

tions will be discussed elsewhere in detail, but for now we can simply call 
attenuon lo the need for expectancy control groups 

If expenmentere can, and if teachers can. then probably healers, 
parents, spoases. and other “ordinary" people also can affect the behavior 
o ose wi w om t ey interact by virtue of their expectations of what that 
e avior wi c course, we must now try to learn how such commumca 
uon of expectancies takes place Considenng the difficulties we have had 
■n trying to answer that same question for the case of experimenters, whose 



415 


References 

proach-avoidance reactions to patients’ expression of hostility ^mer Psy- 
BxttfB ' seientifle discovery « 1961, IS4. 

bxIb^t x.&cxt-vBKUBv.D s 

hhe” hypnotic behavior. 

Xt’s on s;ggestibihty of “.SioK". S 585-"93® 

response to suggestions as easy J abnorm s y 

BrxKt,.P G interaction effects i^o„gce« 

characteristics on a projective test Unpublished doctoral 

of Washington, 1963 New York Harcourt, 

Barzun, J . & Graff. H F The modern researcher New 

Brace & World, 1957 & Weakland, I H Toward a 

Bateson, G, Jackson, D D, H^t-EV, j , , ^64 

theory of schizophrenia, Behav Set . W , , Bgobachtungsfehler Forl- 
Bauch M Psychologische Untersuchungen uber Beona 

schr Psychol , 1913, 1, 169-226 clinical examination in nutri- 

Bean, W B An analysis of subjectivrty m the clinical 

tion, J appl Physiol 1948, 1. 458-468 longevity of error Trans 

Bean.wT Cherry angioma-a digression on the longe y 

Assoc Amer Physicians, 1953, 66 2 j biological sciences in 

bean, W B a critique of criticism m medic^ a^ the S 

1958 Perspectives in biol Med 1958, 1. 2 physicians, 

Bean, W B The natural history of error Trans Asso 

1959,72,40-55 . , interpretation of levels 

Beauchamp, K L , & May, R B p^p 1964, 14, 272 

of significance by psychological researchers y York Harcourt, 

Beck, W S Modern science and the nature of life 

Brace & World, 1957 , „saonses Quantiiaiive effects o! 

Beecher, H K Measurement of subjective P 

drugs New York Oxford, 1959 pvnerimental investigation an 

BelJk. L The concept of 

study of the concept Piyc/iiol 1944, , Aee and sex m the mtervi 

Benney, M , Riesman, D , & Star, Shirle 

44mer J Social , 1956, 62, 143-152 deviation New Yor 

Bero. I a , & BASS, B M (Eds ) Conformity and 

Si,.., ‘ 

H EH.c,s ot pti,. '’V'’"'- 

forced reaction time ot schizophrenics an 

1964, 69. 522-530 v(»roaret The error of es ^ 

Berkson, j , Magath, T B , & ^ hemocytometer Amer 

the blood cell count as made with th 
1940, 128, 309-323 



REFERENCES 


Aas, a , O’Hara, J W , & Munger, M P The measurement of subjective ex- 
periences presumably related to hypnotic susceptibility Scand J Psychol, 
1962, 3, 47-64 

Allport, F H Theories of perception and the concept of structure New 
York Wiley, 1955 

Allport, G W The role of expectancy In H Cantril (Ed ), Tensions that 
cause wars Urbana, 111 Umver of Illinois Press, 1950 Pp 43-78 
Allport, G W , & Vernon, P E Studies in expressive movement New 
York Macmillan, 1933 

Anderson, Maroaret, & White, Rhea A survey of work on ESP and 
teacher-pupil atliludes J Parapsychol , 1958, 22, 246-268 
Aronson, E , & Carlsmith, J M Performance expectancy as a determinant 
of actual performance / abnorm soc Psychol, 1962, 65, 178-182 
Aronson, E , Carlsmith, J M , & Darley, J M The effecis of expectancy 
on volunteering for an unpleasant experience J abnorm soc Psychol, 1963, 
66, 220-224 

I’™’ P^yohology Englewood Cliffs, N J Prentice-Hall, 1952 

N, H , Holz, W , Ulrich, R , & Goldiamond, I The control of the 

content of conversation through reinforcement J exp anal Behav , 1961,4, 

Babich F R , Jacobson, A L , Bubash, Suzanne, & Jacobson, Ann Trans- 

° A naive rats by injection of ribonucleic acid extracted from 

trained rats Science, 1965, J49, 65^^57 

**1951^ 4^9 “"""onication J abnorm sac Psychol, 

■-'“■"'ng and the scientific enterprise Psychol Rev , 1953, 60, 

P *'“"fP“"‘ the study of the history of psychology Paper read 

Psychoiog,s,,mUo,Ts£^m°T°’‘ 

“r^’u “ript^'niier* :l 

Bandura, a, Libsiier, D H , & Miller, p^ula E Psychotherapists’ ap- 

414 



References 

„„ ^1.™ „ U ol «» -«1 “f 

ss:4 »,n,.™ l p.,. 

or 7-r ■"«“.« 5*.;"?'“'' “ 

problem of racial psychology J on Princeton Prince- 

Cr^TRiL, H , & research associates Gaugmg pubUc opmwn 

tonUmver Press, 1944 consequences of the con- 

Carlsmith, J M,&Aronson. E Some hedo ^ 

flrmation and disconfirmation of expectan 

1963, 66, 151-156 , Elects in personality re- 

CARLSON, E R , & CARLSON, Rae , Mate “d f^ide so j P 

search J abnorm soc Psychol , I960, 61,4 ^ Relationship of 

Cervin, V B , Joyner, R C , Spence, . dyadic groups when the ongi- 
persuasive interaction to change of and publicly f u'’™™ 

L opinions of participants are expressed privately P 

soc Psychol , 1961,62,431^32 Vomitive dissonance Five years 

CHARANis, Natalia P. & CHAPAN.S, A Cogmtiv 

later Psychol Bull, 1964 61, 1-22 „a.vete Psychol Bull , 

Christie, R Experimental naivete an p « 

1951,45.327-339 ^ ^ ewers J Res > 1927,^, 

Clark, E L The value of student in 

204-207 , „ciaUv disadvantaged childre 

Clark, K B Educational leas New York Teacher 

In A H Passow (Ed ) , EducaUon >« 

College,Columb.aUniver,1963 anxiety and subjects 

Cleveland, S The relationship between 

Rorschach scores Microfilm Abstr , ’-nenment on observers bias i 
Cochran, W G, & Watson, D J An 1936 , 4 , 69-76 

selection of shoot-heights Empire exp q^eenino, T C , Ma . ' 

Coeeev,H S , Dorcos, R M , Glaser E M^G^^ ,„teract.on Re 

&Sarason,IG Learning io work , Mm Psychol 

search Institute, 1964 nf suERCstion and suggesUb y 

Coffin, T E Some conditions ot s ^ 

Monogr, 1941,53,No 4 (Whole No 2 ) arc/i New York 

Colbv,KM Aninlroducuonlopsychoanalync 

B«>ks. I960 , and leader variation on 

Cole, D L The influence of task per pt (Abstract) ^ ^ 

kinetic responses Amer Psychologis , — gasurement A reply 

Conrad, HS Some principles o^atti ud^-^^ dif- 

attitude methodology ' Psychol B , u,escent Some I 9 j 8 

Cook-Marquis, Peooy Authoritari -Washington, D • P j 

ferences Paper read at Amer classical conditioning 

CORDARO, L, & ISDN, J R O'”,'"" tS ^ „ 1945-46, 

planarian Psychol Rep , 1963, 13, ii,jjg publ Opif^ 

Crespi, L P The cheater problem m p 
9, 431-445 


417 



416 


References 


Bernstein, A S Race and examiner as significant influences on basal skm 
impedance / pers soc Psychol , 1965, 2, 346-349 
Bernstein, L A note on Christie’s “Experimental Naivete and Experiential 
Naivet^ ” Psychol Bull , 1952, 49, 38—40 
Bernstein, L The effects of variations in handling upon learning and reten- 
tion J comp physiol Psychol , 1957,50, 162—167 
Betz, Barbara J Experiences in research in psychotherapy with schizophrenic 
patients In H H Strupp, & L Luborsky (Eds ), Research in psychotherapy 
Washington, D C American Psychological Association, 1962 Pp 41—60 
Binder, A , McConnell, D , & Sjoholm, Nancy A Verbal conditioning as 
a function of experimenter characteristics J abnorm soc Psychol, 1957,55, 
309-314 


Bingham, W V D , & Moore, B V How to interview (3rd rev ) New York 
Harper & Row, 1941 

BiRDwmiSTELL, R L The kmesic level in the investigation of the emotions In 
P H Knapp (Ed ), Expression of the emotions in man New York Interna 
tional Universities Press, 1963 Pp 123-139 

Birney, R C The achievement motive and task performance A replication 
J abnorm soc Psychol 1958, 56 133-135 

Blankenship, A B The effect of the interviewer upon the response in a pub 
he opinion poll J consult Psychol, 1940,4. 134-136 

Boring, EG A history of experimental psychology (2nd ed ) New York 
Appleton Century Crofts, 1950 

Boring, E G TTie nature and history of experimental control Amer J 
Psychol. 1954, 67 573-589 

Bowno, E G Science and the meaning of its history The Key Reporter, 1959, 
24, 2—3 

Bowno, E G Newton and the spectral lines Science, 1962, 136, 600-601 
(a) 

Bowno, E G Parascicnce Contemp Psychol, 1962,7, 356-357 (b) 

Brooden, W J Animal studies of learning In S S Stevens (Ed ), Womftiw* 
o! experimental psychology New York Wiley, 1951 Pp 568-612 
RTCDEN, W J The experimenter as a factor m antmal conditioning Psychol 
Rep , 1962, 11, 239-242 


SWIK, E Perception and the representative design of psychological ex 
nifcT „ California Press, 1956 

16 behavior Psychol 

'’“oc Pry”w ?95T5“' 249-250^"*’“' “"‘’“'“"'"S ^ 


VacEWE, 4 Verner, Helen W Interviewer bias 
1947 T 63-77 ■' ’ 


Cahen, L. S 
teacher bias 


An experimental manipulation of the ‘ Halo Effect” 
Unpublished manuscript, Stanford Umver , 1965 


A study of 



References 


419 


Ehrlich, June S , & Riesman, D Age and authority in the interview Publ 

Opin gwarf , 1961, 25, 39-56 ♦ ca 

Ekman, P , & Friesen, W V Status and personality of the 

determinant of verbal conditioning Amer Psychologist, 1960, 15, 430 

Em'c V Discrimination and learning ™*out aw^ries^ = 

logical survey and evaluation Psychol Rev , 19 , , Umver 

Eriksen, C W (Ed ) Behavior and awareness Durham, N C 

E.Sse;,'c W, Kuetbe, J L, & SULLIVAN D F 

lates of learning Without verbal awareness ers , ’ L 

Escalona, SIBYLLE, K Feeding disturbanc^ in ™y g ^ & 

Orthopsychiat , 1945, J5, 76-80 Also in G E Swanson, i « 

E L Hartley et al (Eds ), Readings ,n Social Psychology (Rev ) ^ 

York Holt, Rinehart and Winston, 1952 Pp 29 ” ,„ter- 

Exline, R V Explorations in the process of pjson P P jg 63 

actio; in relation to competition, sex, and need for affiliation 

™ n„»ATHV Visual behavior in a dyad 
Exline, R V , Gray, D , & Schuette, Doro psychol , 

as affected by interview content and sex of respo 

1965, 1, 201-209 , and the controversy 

Eysenck, H J The concept of ,71 

about one-tailed tests Psychol Rev, 1960, . 

Feinstein, AR The stethoscope a source of 

errors m rheumatic heart disease J chronic * ' ’ task perform- 

Felice, A Some effects of subject examiner ^ 

ance of schizophrenics Dissert Abstr , > i 52 , 1625-1627 

Fell, Honor B Fashion in cell biology Scienc • • j ,n,erviewer bias 

Ferder, R, & Wales, H G Detection and correction 

Publ 0pm Quart, 1952, 16, 107-127 of hostile verbs in rela- 

Ferguson, D C , & Buss, A H Operant cond ® psychol , I960, 

tion to experimenter and subject characteris ic 

24, 324-327 ^ N^w York Harper & Row. 

Festinger, L a theory of cognitive dissonan 

PhslLr, E, . CARLSMIXH, J M Cogni.ive^niT^" 7 

pliance, J- ' ,;d his case reports .mer ry 


Filer, 


cmogist, 1952, 7. 336 (Absiraci; credibility, ana 

Foie, B j Conclusion drawing, oommunicati . 369-374 

factors in opinion change J abnornt soc Ann Sci , 19 . » 

F«her, r a Has Mendel’s work been rediscovere 

n ' '5-337 ,4th ed ) Edinburgh and London 

Fisher, r a The design of experiments t 

Oliver & Boyd, 1947 4 non-verbal interaction on o P 

Fode, K L The effect of non-visual o'"' North Dakota, I960 

menter bias Unpublished master’s thesis, Lin 



418 


References 


Criswell, Joan H The psychologist as perceiver In R Tagiuri, & L 
Petrullo (Eds ), Person perception and interpersonal behavior Stanford, 
CaUf Stanford Umver Press, 1958 Pp 95-109 

Crow, Linda Public attitudes and expectations as a disturbing variable in 
experimentation and therapy Unpublished paper, Harvard University, 1964 

Crowne, D P , & Marlowe, D The approval motive New York Wiley, 
1964 

Crumbaugh, J C ESP and flying saucers A challenge to parapsychologists 
Amer Psychologist, 1959 , 14 604-606 

Crutchfield, R S Conformity and character Amer Psychologist, 1955, 
10, 191-198 

Cutler, R L Countertransference effects in psychotherapy J consult 
Psychol . 1958, 22, 349-356 


Dailey, J M Verbal conditioning without awareness Unpublished doctoral 
dissertation, Umver of Iowa, 1953 

Das, J P Prestige effects in body sway sueeestibilitv J abnorm soc Psychol, 
1960. 61, 487-488 

Delboeuf, j L R Le magnetisme animal a propos d une visite a I ecole de 
Nancy Paris Alcan 1889 

Dember, W N The psychology of perception New York Holt, Rinehart and 
Winston, 1960 

Deuisch, M , & Collins, Mary E The effect of public policy in housing 
projects upon interracial attitudes In G E Swanson T M Newcomb, E L 
art^, et al (Eds ), Readings tn soaal psychology (Rev ed ) New York 
Holt, Rinehart and Winston, 1952 Pp 582-593 

Dulany, D E , & O Connell. D C Does partial reinforcement dissociate 
verbal rules and the behavior they might be presumed to control’ 1 verb 
Learn verb Behav , 1963, 2, 361-372 


^ A contribution to experimental psychology (1885) 

Sr r L * «ara E BuLnius New York Teachers 

college, Columbia Umver ,1913 

and ^ N Response variance and biases m censuses 

12-35 Llnstilul International de Statistique, 1958, 36-20, 

°um”rSp“r'l9Mrr Administralion Con 
Editorial Board Science An unfortunate event Science 1961, 134 945- 

'^'nXRmthSanl'winrrmr*" 

fFH 1 Their planning and execution In G Lindzey 

^ 1 Cambridge. Mass Addison 

EhRENFREUND, D a <5fiiHu rst ,u a 

1952 43 81 87 transposition gradient / exp Psychol 



Refoences 


Goldfbied. M R, & Walters, G C Needed Pubheahon of negative re 

suits Amer Psychologist, 1959, 14, 598 
Goldstein A Therapist and client expectaUon of personality change 

cSS.tr, ' 1 x-v- 

oI «» ..pm.™.-, w "2,;"“ 

atUtude change experiment Paper read at Midwes y 

cS.tv t d™. m a -n. .1 "f 

Stanford Binet Scale / genet upon Rorschach 

Graham, S R The influence of therapist character str^^ 
changes in the course of psychotherapy Amer Psycholog 

OiStS, M . .1— •»— “"I-" ™ 

A.-,..— =»* •<., 

Pjyc/io/opii/, 1961, id, 307— 311 Van Nostrand, 

GRuiNRERO, B C The story of evolutton Princeton, NJ 

1929 , j .4 1 New York McGraw- 

Guilpord, J P Psychometric methods (2nd 
HiU, 1954 , , _ New York Harper & 

Guthrie, E R The psychology of human fl 
Row, 1938 

r The placebo problem Psycho- 
Haas, H, Fink, H, & Hartfelder, ^ ^ 

pharmacol Serv Cent Bull , 1963, 2, 1- j.,,™ m clinical psychology 

Hammond, K R Representative vs systematic design 

Psychol Bull , 1954, 51, 150-159 „„H,tioninE and its relation to 

Han1,C F,&Whitnev,E R 

anxiety level Amer Psychologist, I960, , psychology Psycho 

Hanley. C , & Rokeach, M Care and carelessness P I 

Bull, 1956, 53 183-186 Pneland Cambridge Univer 

Hanson, N R Patterns of discovery Cambri g , g 
Press, 1958 interviewer on the accuracy 

Hanson. R H , & Marks, E S Influence o g35_655 

of survey results J Amer Statist Assoc . ’ jjqsis of delinquents ^ 

Harari.c,&Chwast,J Class bias in psychodiagn 

Psychologist 1959, 14, 377-378 (Abstract) ggetto New 

Harlem Youth Opportunities Unlimited, 

York Author, 1964 interviewing problems n 

Harris, Natalie Introducing a symposium 

Opin Attit Res 1948, 2 69-84 j j peldman, C ' ’ 

Hart.cW PrefacetoHHHyman. WJ a^ Univer of Ch g 

&C H Stem6er,Intervieivingmsocialresearch Cn 

•’rass, 1954 ,-„ev and reactions to the 

Harvey, O j , & Clapp, W F ^ope. exp 
expected J pers soc Psychol , 1965, » 



References 


420 

Fode, K L The effect of experimenters’ and subjects’ anxiety and social 
desirability on experimenter outcome bias Unpublished doctoral dissertation, 
Univer of North Dakota, 1965 

Foster, R J Acquiescent response set as a measure of acquiescence J 
abnorm soc Psychol , 1961, 63, 155—160 

Foster, W S Experiments on rod divining / appl Psychol, 1923, 7, 303— 
311 

Frank, J Discussion of Eysenck’s “The effects of psychotherapy ” Int / 
Psychiat, 1965, 1, 150-152 

Freiberg, A D , Vaughn, C L , & Evans, Mary C Effect of interviewer 
bias upon questionnaire results obtained with a large number of investigators 
Amer Psychologist, 1946, 7, 243 (Abstract) 

Friedman, N The psychological experiment as a social interaction Unpub- 
lished doctoral dissertation, Harvard Univer , 1964 

Friedman, N , Kurland, D , & Rosenthal, R Experimenter behavior as an 
unintended determinant of experimental results J pro) Tech pers Assess , 
1965, 29, 479-490 

Friedman, Pearl A second experiment on interviewer bias Sociometry, 1942, 
S, 378-379 

Fromm-Reichmann, Frieda Principles of intensive psychotherapy Chi- 
cago Univer of Chicago Press, 1950 

Fruchter, B Introduction to factor analysis Princeton, N J Van Nostrand, 
1954 

Funkenstein, D H , King, S H , & Drolette, Margaret E Mastery of 
stress Cambridge, Mass Harvard Univer Press, 1957 


Gantt, W H Autonomic conditioning In J Wolpe, A Salter, & L J 
Reyna (Eds ), The conditioning therapies New York Holt, Rinehart, and 
Winston, 1964 Pp 115-126 

Garfield, S L , & Affleck, D C Therapists’ judgments concerning patients 
considered for therapy Amer Psychologist. 1960,75,414 (Abstract) 
arrett, H E On un-Amencan science reporting Science, 1960, 132 685 
eldard, F A Some neglected possibilities of communication Science, 1960, 
131. 1583-1588 

Gelfand, Donna M , & Winder, C L Operant conditioning of verbal be- 
dysthymics and hysterics J abnorm soc Psychol, 1961, 62, 

000—689 

G^rge, W H The scientist m action A scientific study of his methods New 
York Emerson, 1938 

^ ^ oh]ecUvity Princeton Princeton Univer Press, 


Glucksberg, S , & Lince, D L The influence of military rank of experi 
menter on the conditioning of a verbal response Tech Mem 10-62, Human 
Engineering Lab , Aberdeen Proving Ground, Maryland, 1962 
Goldberg, S, Hunt, R G, Cohen, W, & Meadow, A Some personality 
corre ates of perceptual distortion in the direction of group conformity 
Amer Psychologist. 1954. 9. 378 (Abstract) 



423 


References 

Joel, W The interpersonal equation in projective methods J pro] Tech , 

Johnson! VM"^*Audition and hahit formation in the dog Behav Monogr , 
1913, 2, No 3 (Serial No 8) fio-sn 

Johnson, ML Seeing’s believing New Bio/ogj, 1953, J5, 

Jones, E E Conformity as a tactic of ingratiation Science, 1965, 

, TmnAiiT J W Interaction goals as bases of inference in inter- 

Jones, E E ,& Thibaut, J w. imciduu ^ person perception 

personal perception In R Tagiuri * ^ ^ ^ . rLiver Press 1958 

and .merperscnal behav, or Stanford, Calif Stanford Univer Press, 

JoNL,F'p"'Exper>n'ental method in anuquity Amer Psycholops,. 1964, J9. 

Jon!!, R H Physical indices and clinical 

schoolchildren J Royal Statist 5oc,Part , or fact? Contemp 

JORDAN. N The mythology of the non obvious-autism or 

Psychol , 1964, 9, 140—142 

Kagan, J , & Moss, H J Birlh tomaturUy ^,„'^!b!ect mleraction 
Kanfer, F H , & Karas, Shirley C P"" “f "”“353 ‘ 

and verbal conditiomng Psychol Rep. q„,„ Quart. 1942, 6. 

Katz, D Do interviewers bias poll results^ PM Op,n n 

^‘‘8-268 , _ desegregation on the intel- 

Katz, I Review of evidence relating to jp, 381-399 

lectual performance of Negroes Amer Patricia The influence of 

Katz, I , Robinson, J M , Epps, E G , & ’.uq expression of hostility by 

race of the experimenter and instructions up 

Negro boys J soc Issues. 1964, 20, 54-5 ^ communication Unpub 

Katz, R kdy language A study m unintentional 

lished doctoral dissertation, Harvard Univ , impressions of persons 

Kelley, H H The effects of expectations p 

Amer Psychologist, 1949,4,252 j ••suspicious" versus 'trusting 

Kelley, H H ,& Ring, K Some effects 294-301 

training schedules J abnorm soc ^ t Jniver of Chicago 

Kellog.W N Porpoises and sonar Chicag 399-404 

Kellog, W N Sonar system of the blind ' New Vorh Norton, 

Kelly, G A The psychology of personal constru 

1955 „f response restriction 

Kelman, H C Attitude change as a function 
Hum Relat, 1953,6 185-214 „,hiects The problem of dec p 

Kelman, H C The human use of human J ^^mer Psj 

hon in social psychological experimen 

Assoc , Chicago, September. 1965 whispering " 

Kennedy, J L Experiments on ‘uncon 

‘938.35,526 (Abstract) „ of extra-sensory perception U 

Kennedy. I L A methodological review 
bull , 1939. 36, 59-103 _ on the nature of extr 

Kennedy, J. l , & Uphoff, H F Expenm 



422 


References 


Harvev, S M A preliminary investigation of the interview Bnt J Pi^chol, 

193 8, ’2s, 263-287 

Hefferline, R F Learning theory and clinical psychology — an eventual 
symbiosis? In A J Bachrach (Ed ), Experimental foundations of clinical 
psychology New York Basic Books, 1962 Pp 97—138 
Heilizer, F An exploration of the relationship between hypnotizability and 
anxiety and/or neuroticism J consult Psychol, 1960,24,432-436 
Heine, R W , & Trosman, H Imtial expectations of the doctor-patient inter- 
action as a factor in continuance in psychotherapy Psychiatry, 1960, 23, 
275-278 

Heller, K , Davis, J D , & Saunders, F Clinical implications of laboratory 
studies of interpersonal style Paper read at Midwest Psychol Assoc , St 
Louis, May, 1964 

Heller, K , & Goldstein, A P Client dependency and therapist expectancy 
as relationship maintaining variables in psychotherapy / consult Psychol , 
1961,25, 371-375 

Heller, K , Myers, R A , & Vikan-Kline, Linda Interviewer behavior as a 
function of standardized client roles J consult Psychol, 1963, 27, 117—122 
Helson H Adaptation level theory New York Harper & Row, 1964 
Homans, G C Social behavior Its elementary forms New York Harcourt, 
Brace & World, 1961 

Homme, L E , & Klaus, D J Laboratory studies in the analysts of behavior 
Pittsburgh Lever Press, 1957 

Honigfeld, G Non specific factors in treatment Dis nerv Syst , 1964,25, 
145-156, 225-239 

Hovland, C I , & Janis, I L (Eds ) Personality and persuasibility New 
Haven, Conn Yale Univer Press, 1959 

Hovland, C I, & Weiss, W The influence of source credibility on com- 
munication effecUveness Publ Opin Quart, 1951 15 635-650 
Hyman, H H , Cobb, W J , Feldman, J J , Hart, C W , & Stember, C H 
Interviewing in social research Chicago Umver of Chicago Press, 1954 

Ismir, a a The effects of prior knowledge of the TAT on test performance 

Psychol Rec , 1962, 12 157-164 

Ismir, A A The effect of prior knowledge, social desirability, and stress 
upon the Thematic Apperception Test performance Unpublished doctoral 
dissertation, Univer of North Dakota, 1963 

Jahn. M E , & Woolf, D J (Eds ) The lying stones of Dr Johann Bartholo 
mew Adam Beringer being his Lithographiae Wirceburgensis Berkeley 

Umver of California Press, 1963 
James, W Essays in pragmatism New York Hafner, 1948 
ANis, I L Anxiety indices related to susceptibility to persuasion / abnorm 

roc Psychol, i955, 51, 663-667 

Jastrow, J Fact and fable in psychology Boston Houghton Mifflin, 1900 
Jenness, a The role of discussion in changing opinions regarding a matter of 
fact J abnorm soc Psychol 1932, 27, 279-296 



425 


References 

LUFT I Interaction and projection J proi Tech , 1953, 17, 489-492 
M S B ROSS, S , Kruoman, A D , & Clyde, D I Drugs and placebos 

“ffecl’of ins’tructions upon P-formance and moo under amp etamine 

sulphate and chloral hydrate J abncrm eoc P^chol . 1964, 68 , 321 

T’ c \fArroBY N The interview A tool of social 

Maccoby, Eleanor E, & Maccoby, w n^rholoey Vol I Cam 

science In G Lindzey (Ed ), Handbook 
budge. Mass Addison-Wesley, 1954 PP '*'‘9-487 
MacDouo*ll,C D Hoaxes New York Macmilto, 940 
MACKINNON, D W The nature and nurture of creative talent 4 

chologist. 1962, 77, 484-495 -,„t,stical sampling m the Indian 

Mahalanobis, P C Recent experimen ' 325-370 

Statistical Institute 7 Royal Statist Soc , , > ^xtralinguisUc area 

Mahl, G F , & SCHULZE, G P^ycholog '^' %iTApproaches to 
In T A Sebeok, A S Hayes, & Mary C Bateson (Eds), PP 

semiotics The Hague Mouton, 1964 Pp 51 * p^chol Rev, 

Maier,NRF Frustration theory Restatement and extension 

1956, 63, 370-388 ,o60 75,208-212 

Maier, N R F Maier’s law Amer Psycholog ■ ’ jjtecls on 

Marcia, J Hypothesis making, need thesis, Ohio State 

unconscious expeumenter bias Unpublished masters 

Umver , 1961 .v. examiner upon Stanford- 

Marine, Edith L The effect of familiarity 42 

Binet test performance Teach Coll contr ■ therapies The oft- 

Marks, M R How to build better 793.798 

quadrant approach Amer Psychologist, ’ ’ , proiecUve instruments 

Marwit, S , & Marcia, J Tester bias and resimnse toj^^ 1^ 

Unpublished paper State Umver '^^.^aCon on the admmishation 

MaslSng, I -ne effects of warm and cold , 959 , 23 336-341 

and scoring of an intelligence test 7 ,„_pfsonal variables in projcc 

Maslino, I The influence of situational and interpe 
twe testing Psychol Bull . 1960,57, 65-45 Rorschach responses 

Maslino, I Differential indoctrination of examiners 
7 consult Psychol, 1965,29, 198-201 
Matarazzo, j D , Saslow, G , & Pare*s, 

’ ' .. ronsid 


verbal eonddioning^of t"® 


atarazzo, I D , Saslow, G , & Pareis, *- ‘ , ns 7 abnorm 
response elasses Some methodological con 
chol, 1960, 67, 190L-206 - Studies m intervicv. sp^ 

Matarazzo, I D, Wiens, A N , & Saslo , pisearch J’" 

behavior In L Krasner & L P nom New York HoU, Rm® 

modification New developments and imp 

hart and Winston. 1965 Pp I81-2I0 of >art3non > 

Mausner, B Studies in social r pairs 7 appi psycho . 

partner’s prestige on the interaction o o s , . -nt ta^l* 

^7.391-393 , success or failure m a rclc 

Mausner, B The effect of one partners psychol. 

on the interaction of observer pairs 

557-560 



424 


References 


perception III The recording error criticism of extra-chance scores 1 

Pnrop^yc/ioi , 1939, 3, 226-245 « ♦ t c IQ^Q 729 

Kety, S S Biochemical theories of schizophrenia. Part I Science, 1959, 729, 


1528-1532, Part II, 1590-1596 

Kimble, G A Classical conditioning and the problem of awareness ■' ' 

1962. 30. Supplement C W Enksen (Ed ). Behavior and awareness, 27-^5 
Klein, G S Perception, motives and personality In J L McCary (Hd ), 
Psychology of personality Six modern approaches New York Logos, 1950 


Koestler, a The act of creation New York Macmillan, 1964 
Kramer, E , & Brennan, E P Hypnotic susceptibility of schizophrenic pa- 
tients / abnorm soc Psychol , 1964, 69, 657—659 
Krasner, L Studies of the conditioning of verbal behavior Psychol Bull, 


1958,55, 148-170 

Krasner, L The therapist as a social reinforcement machine In H H Strupp 
& L Luborsky (Eds ), Research m psychotherapy Washington, D C Amer 
Psychol Ass, 1962 Pp 61-94 

Kubie, L S The use of psychoanalysis as a research tool Psychiat Res Rep , 
1956, 6,112-136 

Kuethe, J L Acquiescent response set and the psychasthenia scale An 
analysis via the aussage experiment / abnorm soc Psychol, 1960, 61, 
319-322 


Lane, F W Kingdom of the octopus New York Sheridan House, 1960 
Lepkowitz, M , Blake, R R , & Mouton, Jane S Status factors in pedestrian 
violation of traffic signals J abnorm soc Psychol 1955,57,704-706 
Levin, S M The effects of awareness on verbal conditioning J exp Psychol , 
1961, 61, 67-75 

Levitt, E E Problems of experimental design and methodology in psycho- 
pharmacology research InR H Branson (Ed ), Report of the conference on 
mental health research Indianapolis Assoc Advance Ment Hlth Res 
Educ,1959 

Levitt, E E , & Brady, J P Expectation and performance in hypnotic phe 
nomena J abnorm soc Psychol, 1964, 69, 572-574 
Levy, L H , & Orr, T B The social psychology of Rorschach validity re- 
search J abnorm soc Psychol 1959, 58. 79-83 
Liddell, H S The alteration of instinctual processes through the influence of 
conditioned reflexes In S S Tomkins, Contemporary psychopathology 
Cambridge, Mass Harvard Univer Press, 1943 
Lindquist, E F Design and analysis of experiments in psychology and educa 
tion Boston Houghton Mifflin, 1953 

Lindzey, G a note on interviewer bias / appl Psychol, 1951, 35. 182-184 
London, P , & Fuhrer, M Hypnosis, motivation, and performance J Pers 
1961,29, 321-333 

Lord, Edith Experimentally induced variations in Rorschach performance 
Psychol Monogr , 1950, 64, Ho 10 

^ Lubin, a Replicability as a publication criterion Amer Psychologist, 1957, 
72,519-520 



References 

MURPHY. G Scence m a straight jackeG Conlemp P^chol. 1962. 7. 357- 

MotLy. H a Techniques for a systematic investigation of fantasy 1 Pry- 
cJioi , 1937. 3. 115-143 

Nurolc. Fraoa. Narolu. R , & Howaro P H Potion of women in child- 

birth Amer J Obstetrics Gynecol . 1961. S2. 943 95 

Naroll. R Data quahty control-a new research technique M 
Macmillan, 1962 Rmehart and 

T M n, rr-’- N- "A »«»■ «" 

zr*;” r». .1.— . A—'' — 

A ,.™. 0, 

technique Educ psychol Measmt , 19 , » 

Orne. M T The nature of hypnosis Artifact and essence 1 

Psychol 1959. 5S. 277-299 „,.,i,„lr,i„cal experiment With 

Orne. M T On the social psychology of the p y S ,n,pbcations Amer 
particular reference to demand characteristics and their imp 

Pjyc/io/ogiJf, 1962, 17, 776-783 

Palmer. L R New evidence m Knossos affair London The Sunday 0 
server, 1962 (Feb 11) , , --rsonality and to the social 

Parsons. T The American family Itsrelatio ^„„„iaation and mteraction 

structure In T Parsons. & R F Bales. Fomily, socwlir 
process New York Free Press. 1955 Pp , inaction process 

Parsons. T.& bales. R F Fam.ly, soctahzatton an 

New York Free Press. 1955 Working papers "s ” 

Parsons. T . Bales. R F . & Shils. E A 

action New York Free Press. 1953 r —rors of ludgmcnt with spcaa 

Pearson. K On the mathematical theory of London 1902 . 19 ■ 

reference to the personal equation 

235-299 V, „n the mediation of expen- 

Persinoer. G W The effect of of North Dakota. 

taenter bias Unpublished master s thesis. , ung situation with par 

Pflugrath. J Examiner influence in a grop ^^^ U„,^er of 

tcference to examiner bias Unpublishe . lo 

Dakota. 1962 ^ Osten) 4 ""'"'’“Rjhn 1 

PfUNosT. O Clever Hans (the horse of A .-jranslatcd by C L 

^^penmental, animal and human psyc to og 

York tow - rhicaco 


427 


^*periniental, animal and human jg 

^Ncv.York Holt. 1911 „n,^cr of Chicago Pr • 

Pouvvi. M Personal knots ledge Chicago problems of P ' P 

Pounai, M Tacit knowing Its ,oi0- 

fleiieBjo/Afodern P/iysici. 1962. J4. , -n Scienef. 1P^3. 

'“Gsti. M The potential theory of adsorption 

iota * 



References 

426 

Mausner, B , & Bloch, Barbara L A study of the additivity of vanables 
affecting social interaction J abnorm soc Psychol, 1957, 54. 250-256 
McClelland, D C Wanted A new self image for women In R J Litton 
(Ed), The woman in America Boston Houghton Mifflm, 1965 Pp 173- 
192 

McFall, R M “Unintentional communication” The effect of congruence 
and incongruence between subject and experimenter constructions Unpub- 
lished doctoral dissertation, Ohio State Univer , 1965 
McGuigan, F j The experimenter A neglected stimulus object Psychol 
Bull. 1963, 60, 421-428 

McNemar, Q Opinion-attitude methodology Psychol Bull, 1946, 43, 289- 
374 

McNemar, Q At random Sense and nonsense Amer Psychologist, 1960, 
J5. 295-300 

McTeer, W Observational definitions of emotion Psychol Rev, 1953, 60 
172-180 

Merton, R K The self-fulfilling prophecy Antioch Rev , 1948, 8, 193—210 
Miller, J G Unconsciousness New York Wiley, 1942 
Mills,! Changes in moral attitudes following temptation J Pers , 195^, 26 
517-531 

Mills, T M A sleeper variable in small groups research The experimenter 
Pacific sociol Rev 1962,5 21—28 

Milmoe, Susan, Rosenthal, R , Blane, H T Chafetz, M E , & Wolf, I 
The doctor’s voice Postdictor of successful referral of alcoholic patients 
Unpublished paper, Harvard Univer, 1965 (/ abnorm Psychol, 1966, in 
press ) 

Mintz, N On the psychology of aesthetics and architecture Unpublished 
paper, Brandeis Univer , 1957 

Moll, A Hypnotism (4th ed ) New York Scribner, 1898 
Moll, A Hypnotism Translated by A F Hopkirk (4th enlarged ed ) Lon 
don Walter Scott, New York Scribner, 1910 
Morrow, W R Psychologists’ attitudes on psychological issues I Constric- 
Uve method formalism J gen Psychol. 1956,54, 133-147 
Morrow, W R Psychologists’ attitudes on psychological issues II Static 
mechanical elementarism / gen Psychol 1957, 57, 69-82 
Mosteller, F Correcting for interviewer bias In H Cantril, Gauging public 
opinion Princeton Princeton Univer Press, 1944 Pp 286-288 
Mosteller, F , & Bush R R Selected quantitative techniques In G Lindzey 
(Ed ), Handbook of social psychology Cambridge Mass Addison-Wesley, 
1954 Pp 289-334 ^ fi-' & 

Mosteller F , & Hammel, E A Review of Naroll, R Data quality control 
—a new research technique New York Macmillan, 1962 J Amer Statist 
1963,55.835-836 

Mulry, R C The effects of the experimenter’s perception of his own per- 
formance on subject performance m a pursuit rotor task Unpublished 
master s thesis, Univer of North Dakota, 1962 
Munn, N L Handbook of psychological research on the rat Boston Hough 
ton Mifflin, 1950 



429 


References 

^en — 

k™.T ^"“ty. and acqu.escence ^n.a. FsycHo,o,., 

r™:d' rrlal 

and climcal hypnosis ,„,i,icfion of the defense 

Rosenthal, R An attempt at the Umver of 

meehamsm of projeetion Unpubhshed doctoral d.ssertat.on, 

California at Los Angeles. 1956 unconscious expenmenter bias 

Rosenthal, R Projechon. excitement and unconscio 

Amer Psychologist, 1958, 13, 345 3 ( J „,,h expenmenter 

Rosenthal, R Variation in research 
vanation Unpublished paper. Harvard of subjects’ responses 

Rosenthal, R Experimenter attributes as ' 

1 pro] Tech pers Assess, ^j^^oets as determinants of subject’s 

Rosenthal, R Experimenter n’°de>“'g 467-471 (b) 

responses J pro] Tech pers Assess, I . > j,(,jog,cal expenroent 

Rosenthal, R On the social psychology o ^ of experimental 
The experimenter’s hypothesis as umntended determm 
results Amer Scient, 1963, 51, 268-283 (c) influence Unpublished 

Rosenthal, R Subject susceptibility to experimenter 
paper. Harvard Umver , 1963 (d) . results of psychologic 

Rosenthal, R The effect of the experimenter . „;ona\ity research 

research In B A Maher (Ed ). Progress 

Vol 1 New York Academic Press. 1964 Bp results of Ui 

Rosenthal, R Experimenter 405-412 (b) 

psicliological experiment Psychol Bui . ’ ,j„t,fic method 

Rosenthal. R Clever Hans A case sWdy °f and Winston. 19 

to Pfungst. O . C/ever Hans New York Holt, Rmen 
'■P (ttl „ Rela, 1965. IS 389^^ W 

Rosenthal. R The volunteer subject Hum e „„ 65 „tandings m th p^ 

Rosenthal, R Covert communications an Assoc . Chicago r 

cbological experiment Paper read at Amer } 

t'mber, 1965 (c) r Mneriroenter outcom 

Rosenthal, R. & Fode. K L The ° Xology “^jj 

'“DP Ray (Ed ), Series research m s j social and Be 

«r.es No 8, Washington. D C National Institute 

a '561 „ , „f oxncrimenter bias on the per 

R«tNT,«i,R,iFoDE, K L. '^''''^^963 6^3-189 „ oAfcri 

fo'mance of the albino rat Behai Sa , f.^cscicnust V) 

^'"“'•t.iau R . & Fode, K L. (Psjchologj o' the , 6 , 

in experimenter bias Psychol * vika** ** 

R . Fode, K L-. Friedma'^. C . 



428 


References 


Pomeroy, W B Human sexual behavior In N L Farberow (Ed ), Taboo 
topics Englewood Cliffs, N I Prentice-Hall, 1963 Pp 22-32 
Prince, A I Relative prestige and the verbal conditioning of children Amer 
Psychologist 1962, 17, 378 (Abstract) 


Quart J Stud Alcohol, Editorial staff Mortality m delirium tremens 
No Dak Rev Alcoholism. 1959, 4. 3 Abstract of Gunne, L M Mor- 
taliteten vid delirium tremens Nord Med , 195S, 60, 1021—1024 


Rankin, R , & Campbell, D Galvanic skin response to Negro and white 
experimenters / abnorm soc Psychol, 1955,5/, 30-33 
Rapp, D W Detection of observer bias in the written record Unpublished 
manuscript, Univer of Georgia, 1965 

Raven, B H , & French, J R P , Jr Group support, legitimate power and 
social influence J Pers 1958,26 400-409 
Ravitz, L j Electrometric correlates of the hypnotic state Science 1950, 
112, 341-342 

Ravitz, L J Electrocychc phenomena and emotional states J clin exp 
Psychopathol 1952, IS. 69-106 
Razran, G Pavlov the empiricist Science, 1959, 130, 916 
Reece, M M , & Whitman, R N Expressive movements, warmth, and verbal 
reinforcements J abnorm soc Psychol, 1962, 64 234—236 
Reif, F The competitive world of the pure scientist Science, 1961, 134 
1957-1962 

Rhine, J B How does one decide about ESP*^ Amer Psychologist 1959, 14 
606-608 

Rice, C E , & Feinstein, S H Sonar system of the blind Size discrimination 
Science. 1965, 148, 1107-1108 

Rice, S A Contagious bias in the interview A methodological note Amer J 
Social 1929,55 420-423 

Rider, P R Criteria for rejection of observations IVashington Univer Stud 
New Ser , Sci Tech , 1933, 8 

Riecken, H W a program for research on experiments in social psychology 
InN F Washburne (Ed ), Decwons values and groups Vol II New York 
Pergamon Press, 1962 Pp 25-41 

Riecken, H W , et al Narrowing the gap between field studies and laboratory 
experiments in social psychology A statement by the summer seminar Items 
Soc Set Res Council 1954,5 37-42 

Ringuette, E L , & Kennedy, Gertrude L An experimental investigation 
of the double bind hypothesis Amer Psychologist 1964, /9, 459 (Abstract) 
Robinson, D , & Rohde, S Two experiments with an anti-Semitism poll 1 
abnorm soc Psychol 1946,4/ 136-144 
Robinson, J , & Cohen, L Individual bias in psychological reports J dm 
Psychol . 1954, 10 333-336 

Rodnick, E H , & Klebanoff, S G Projective reactions to induced frustra 
tion as a measure of social adjustment Psychol Bull. 1942, 39, 489 
(Abstract) 

Roe, Ann Man’s forgotten weapon Amer Psychologist 1959, 14 261—266 



431 

References 

effect of expenmenter outcome b.^ and "sMbI 

condiuonmg experiments / verb Learn verb ■ ^^63 2 215 283 W 

ROSENTHAL R . PERSINGER, G W , VKAN KLINE, LINDA. & MULRY R C 1 M 
role of the research assistant m the mediation of experimenter bias 

decepuon m science New York Basic I960 

M B ZjLrnJs and cbn.ca, psycbCogy Englewood Cliffs, N I 

Prentice Hall, 1954 snhiective bias m TAT 

Rotter, J B , & Jessor, Shirley e ^o 1 circa 

interpretation Unpublished manuscript, Ohio State uni 

R™, W W The fallacy of the null hypothesis significance test Psychol 

Bull, 1960, 57, 416-428 

Russell, B Phdosophy New York Norton, ISA 

Sacks, Eleanor L Intelligence scores m 7Zorm sic Psy- 

lished social relationships between child 

cAoM952,47,354-358 _ . „ -cuve and passive 

Sampson, E E, & French, J R P An “P"' 355 (Abstract) 

resistance to social power Amer Psychologis , ’ , (he confirmation 

Sampson, E E , & Sibley, Linda B A further “ “p^chol , 1965, 2, 

or nonconfirmation of expectancies and desires p 

'33-137 , . „ certain examiner 

Sanders, R ,& Cleveland, S E The relatio p 1953,17, 

personality variables and subject's Rorschach scores 

SANPom, R N The effects of abstinence f™"’ 

A preliminary experiment J Psychol, 193 » p verbal conditioning 

Sapolsky, a Effect of interpersonal relationships upon 
7 ahnorm soc Psychol, 1960, 60 241-246 difference variables be 

fi'tASON, I G Interrelationships among mdivi soc Psychol 

ha\ior in psychotherapy, and verbal con itioni 

>958, 56 339-344 , . variables, and persona i ) 

8 ARASON, 1 G Individual differences, situat 
research 2 abnorm soc Psychol 1962, ,1 behavior research n 

8 ''>ason, I G The human reinforcer ^ \^i,a„or modtficahon 
Erasner & L P Ullman (Eds), Beseech Rinehart and Win 

^rvelopmenls and implications New or 
, >965 Pp 231-243 experimental cond.uons 

8 'Rason, I g , & Harmatz, M G Test anxi ) 

7 pen soc Psychol 1965, 7. 499-505 5 „bjccl. es^i 

3''^n, I g , & Minard, j 1963, 67. 87-91 

ind — 1 variables / abnorm soc Ps) research J 

TT,. Sts behavior as an a 


ind 

Svusf 


3 Situational variables J abnorm j ' ^ 

^'^ON, S B The psychologist s behavior a 
Prjehol 1951, IS. 278-280 j- WAITE, R » • *• 

3^‘Eason, s b , Davidson, K S . UcimiAEL. F r,Wle). >9 

® E Anxiely in elementary school c It ' 



430 


References 


jects’ perception of their experimenter under conditions of experimenter bias 
Percept mot Skills, 1960,77, 325—331 

Rosenthal, R , Fode, K L , & Vikan-Kline, Linda L The effect on experi- 
menter bias of varying levels of motivation of Es and Ss Unpublished manu- 
script, Harvard Univer , 1960 

Rosenthal, R , Fode, K L , Vikan-Kline, Linda, & Persinger, G W Ver- 
bal conditioning Mediator of experimenter expectancy effects'^ Psychol 
Rep, 1964, 74,71-74 

Rosenthal, R , Friedman, C J , Johnson, C A , Fode, K L , Schill, T R , 
White, C R , & Vikan-Kline, Linda L Variables affecting experimenter 
bias m a group situation Genet Psychol Monogr , 1964, 70 271—296 
Rosenthal, R , Friedman, N , & Kurland, D Instruction-reading behavior 
of the experimenter as an unintended determinant of experimental results 
Paper read at East Psychol Ass , Atlantic City, April, 1965 (7 exp Res 
Pers , 1966, m press ) 

Rosenthal, R , & Gaito J The interpretation of levels of significance by 
psychological researchers 7 Psychol, 1963, 55, 33—38 
Rosenthal, R , & Gaito, J Further evidence for the cliff effect in the inter 
pretation of levels of significance Psychol Rep, 1964, 75, 570 
Rosenthal, R , & Halas, E S Experimenter effect in the study of invertebrate 
behavior Psychol Rep 1962, 77, 251-256 
Rosenthal, R , Kohn, P , Greenfield, Patricia M , & Carota, N Experi- 
menters’ hypothesis-confirmation and mood as determinants of experimental 
results Percept mot Skills, 1965,20 1237-1252 
Rosentiul, R , Kohn, P , Greenfield, Patricia M , & Carota, N Data 
desirability, experimenter expectancy, and the results of psychological re- 
search, 7 Pers soc Psychol , 1966, 3. 20-27 
Rosenthal, R , & Lawson, R A longitudinal study of the effects of experi- 
menter bias on the operant learning of laboratory rats 7 Psychiat Res , 
1964.2,61-72 

Rosenthal, R , & Persinger, G W Let’s pretend Subjects’ perception of 
imaginary experimenters Percept mol Skills, 1962, 74, 407-409 
Rosenthal, R , Persinger, G W , & Fode, K L Experimenter bias, anxiety, 
and social desirability Percept mol Skills 1962, 75 73-74 
Rosenthal, R , Persinger, G W , Molry, R C , Vikan Kline, Linda, & 
Grothe, M a motion picture study of 29 biased experimenters Unpub- 
lished data, Harvard Univer , 1962 

Rwenthal, R, Persinger, G W, Mulry, R C, Vikan-Kline, Linda, & 
ROTHE, M Changes in expenmental hypotheses as determinants of experi 
mental results 7 proj Tech pers Assess 1964,25,465-469 (a) 
RtKENTHAL, R , Persinger, G W , Mulry, R C , Vikan-Kline, Linda, & 
ROTHE, M Emphasis on experimental procedure, sex of subjects, and the 
lasing effects of experimental hypotheses 7 proi Tech pers Assess, 1964, 
28 470-473 (b) 

Rosenthal, r , Persinger, G W , Vikan-Kline, Linda, & Fode, K L The 
e cct of early data returns on data subsequently obtained by outcome biased 
experimenters Sociometry, 1963, 2<5, 487-498 (a) 

Rosenthal, R , Persinger, G W , Vikan-Kline, Linda, & Fode, K L The 



References 

n n Berger A, & Howard, Kay Conditioning of verbal be 

aw^eness, -d 

receive remtocement d o^^rm roc behaviorism versus cogni 

Spielberger, C D , & De mike, l, p„.ugi Rev 1966, 73, in press 

tive theory in verbal operant conditio g Pi^ conditioning Un- 

Spires A M Subiect-expenmenter mteractjon 

published doctoral dissertaUon, New York T^iver . anniversary of the Psy- 

StLton, F Further contributions at "^"=1^000 Cattel / 
chological Corporation and to honor its f 

appl P^chol , 1942a, 26, 16-17 recall of incompletely 

STANTON, F , & baker, K H 

learned materials ^ocio/nctry, 1942, ' ^ comparison of psychmtric 

Star, Shirley A The screening of psy , g A Stouffer, L Gutt- 

diagnoses and test scores at all induction states ^ ^ ^ ^ 

ma;,E A Suchman, P F LazarsftW, Shirlei^ pp 
Measurement and prediction Prince 

H W How interviewer effects operate through 

Stember, C H , & Hyman, H H How m 
quesbonform Int J Opin Amt Res. j^.rences as affected by self m 
S^HENS, J M The perception of ^all differences 

terest Amer J Psychol , 1936, 48, 480-4 -cssible effecU on 

Steriino, T D Publication decisions and P ^jjoc , 195 , 

drawn from tests of significance orvicever 

54 30-34 ^ . bis law Science. 1961, 14^. 

Stevens, S S To honor Fechner and rep 
80-86 ,,b,idren as a function of ga, 

Stevenson, H W Social reinforcement wi 147-154 

sex of E, and sex of S 7 abnorm soc sy [,b,[dren’s behavior " 
Stevenson, H W Social reinforcement development and beha 

Lipsitt & C C Spiker, (Eds ), , 5X 

Vol 2 New York Academic Press, 1965 ^ce as a 5“"=”°" ‘ gS, 

Stevenson, H W , & Allen, Sara Adult perfmm ,954, 

of experimenter and sex of subject .--nrcrs 

R M parent and strangers 

Stevenson, H W , Keen, Rachel, & j abnorm soc sy 

^ reinforcing agents for children s per o 

>963, 67, 183-186 . ,„„forcement with normal^"^ 

Stevenson, H W , & Knights, R M „ jcx of E and sex of 

retarded children as a function of prctrami 

> mem Defic , 1962, 66. 866-871 reinforcement with chi 

SrrvENsoN, H W,&Odom, R D 1963 pnehot 

published manuscript, Univer of Mmnes ’ obscure sig 

5^tton, G M -Ac control of another person y 

'>''■.1921,28,301-314 iherapisfs eontribui'on 

5'*ui.i..hh Toward an analysts of the (y^bstract) .y^rhing- 

meat process Amer Psychotosisi. *559. ■ , fsychotberapy 

SrxLrr, H H , & Luborskv, L (Eds ) Resea 
ten, DC Amer Psychol Ass , 1962 



432 


References 


ScHACHTER, S The psychology of affiliation Stanford, Calif Stanford Univer 
Press, 1959 

ScHMEiDLER, GERTRUDE, & McCoNNELL, R A ESP and personality patterns 
New Haven Yale Univer Press, 1958 

Schultz, D P Time, awareness, and order of presentation m opinion change 
J appl Psychol , 1963, 47, 280—283 

Science and Politics AMA attacked for use of disputed survey in “Medicare” 
lobbying. Science, 1960, 132, 604—605 

Sebeok, T a , Hayes, A S , & Bateson, Mary C (Eds ) Approaches to 
semiotics The Hague Mouton, 1964 

Shapiro, A K A contribution to a history of the placebo effect Behav Set , 
I960, 5, 109-135 

Shapiro, A K Factors contributing to the placebo effect Amer J Psy- 
chother, 1964, 18, 73-88 

Shapiro, A K latroplacebogenics Unpublished paper, Montefiore Hospital, 
New York City, 1965 

Shapiro, A P The investigator himself In S O Waife & A P Shapiro, 
(Eds ), The clinical evaluation of new drugs New York Hoeber-Harper, 
1959 Pp 110-119 

Sheffield, F D , Kaufman, R S , & Rhine, J B A PK experiment at Yale 
starts a controversy / Amer Soc Psychical Res , 1952,46 111-117 
Sherif, M , & Hovland, C I Social judgment New Haven Yale Univer 
Press, 1961 

Shinkman, P G , & Kornblith, Carol L Comment on observer bias m 
classical conditioning of the planarian Psychol Rep , 1965, 16, 56 
Shor, R E Shared patterns of nonverbal normative expectations in automo- 
bile driving J soc Psychol. 1964,62, 155-163 
Silverman, I in defense of dissonance theory Reply to Chapanis and 
Chapanis Psychol Bull, 1964, 62, 205-209 
Silverman, I Motives underlying the behavior of the subject in the psy- 
chological experiment Paper read at Amer Psychol Ass , Chicago, Septem 
ber, 1965 / » b r 

Simmons. W L , & Christy, E G Verbal reinforcement of a TAT theme 
J pro} Tech . 1962, 26, 337-341 

Smart, R G The importance of negative results in psychological research 
Canad Psychologist, 1964, Ja, 225-232 

Smith, E E Relative power of various attitude change techniques Paper read 
at Amer Psychol Ass , New York, September, 1961 
MiTH H L , & Hyman, H H The biasing effect of interviewer expectations 
on survey results Publ 0pm Quart, 1950, 14, 491-506 
NEDEcoR, G W Statistical methods (5th ed ) Ames, Iowa Iowa State 
Umversity Press, 1956 

Snow, C p The Affair London, Macmillan, 1960 

^ow. C P The moral un neutrality of science Science, 1961, 133, 256-259 
^ ^ extension of control group design Psychol Bull , 1949, 

Spence, K W Anxiety (drive) level and performance in eyelid conditioning 
Bu//. 1964,6/. 129-139 



435 


aid contingent remforcemen S' Kentucky, 1963 

r rr“M™ " Wtky tn tke p.ckopkys.cal — 

- -eet 01 

subjects scholnstie standing on ‘he 

published master’s thesis. Marquette Un , theory Psychol 

WncK, K E When prophecy pales The fate o 

Rep 1965.16.1261-1275 S,a„ford Hypnouc Susc^pP^ 

Weiizenhoffer, a M , & Hilgard. - ,,|t,np Psychologists Pres . 

Scale Form C Palo Alto. California Cons" 'mg ^ “!«"T J 

White, C R The effect of induced ^'*1“' ' U„,ver of North Dakota, 
bias situation Unpublished doctora is , r rmd 

«« the experimental sub,ect / Cmmd 

Whitman, R M Drugs, dreams an 

fs)chiat Assoc , 1963, S, 395-399 Univer Chicago 

Whyte. W F Street corner soctely C^m ^^pport M “ o''* , 

WiltUMs, F , Sc Cantril. H The use o . opinion 1 soc sy 

detecting differences between “public an 

1945,21, 171-175 ^ . „,„,ot.on A study of bias m 

WittUMs, J A Interviewer-respondem ^ 35,352 

information interview Sociometry,^^ ♦ ’.qm 240,1983 „ 

WiLLUMs, L P The Beringer hoax achievement In „ „ 

WitsoN, A B Social stratification and ^oik Teachers Col g 

ww (Ed), Education in depressed are McOraw- 

Columbia Univer , 1963 Pp 217-23 , cr research New nr 

'I'ltsoN, E B An introduction to scien ip McGra»- 

“'"■‘552 cental design 

"'n-ER, B J Statistical principles m experi ,„.„onal van 

'i'll. 1962 experimenter, and si u 

'■'EEL, G H , & Sarason, I G Subject ,964 68 

ablcs in research on anxiety J abnorm utopia 

'"EEH. L Preface to K Mannheim. Mem si ,,,, 

lings rs) 

0 'f-'ailc. A A P 


4-. riciacc lu *’»*• — 

routt, Braced! World, 1936 yVI Uegative 

''“IE. I S Perspectives in psychology. Av. 

1961, U, 91-95 , 1 subiccts In® “ 'yorh Hoeber 

’“'■r. S Human beings as experimenta Ne' 

^piro (Eds ), The clinical evaluation I 

Harper. 19 S 9 Pr, RS_q 9 


“lapiro (Eds), The clinical evaluation 

.^Harper, 1959 Pp 85-99 . difference A" 

“If. Theta H An individual who m ,/,oloS 

'561,16.245-248 ^ crisis Anier PD 

'^f. Theta H Alfred Bind A um pgp 

k science. 

“ifEE. D Research with human su ) 


.chotogai 

rlialogis' 196^- 



References 


434 

Sullivan, H S A note on the implications of psychiatry, the study of inter- 
personal relations, for investigations m the social sciences Amer J Social, 
1936-37,42, 848-861 

Summers, G F , & Hammonds, A D Toward a paradigm of respondent bias 
in survey research Unpublished paper, Univer of Wisconsin, 1965 
Symons, R T Specific experimenter subject personality variables pertinent to 
the influencing process in a verbal conditioning situation Unpublished doc- 
toral dissertation, Univer of Washington, 1964 
Symposium Survey on problems of interviewer cheating Int J Opin attit 
Res, 1947,7,93-106 

Taffel, C Anxiety and the conditioning of verbal behavior J abnorm sac 
Psychol. 1955,57 496-501 

Taylor, Janet A A personality scale of manifest anxiety J abnorm soc 
Psychol , 1953, 48, 285-290 

Tolman, E C Purposive behavior in animals and men New York Century, 
1932 

Troffer, Suzanne A . & Tart, C T Experimenter bias in hypnotist per- 
formance Science, 1964, 745, 1330-1331 
Tuddenham, R D The view from Hovland Headland Contemp Psychol , 
1960, 5. 150-151 

Tukey, j W Data analysis and the frontiers of geophysics Science 1965, 
J48, 1283-1289 

Turner, G C , & Coleman, J C Examiner influence on thematic appercep 
tion test responses / pro] Tech 1962,26.478-486 
Turner,! On being fair though one sided Science, 1961, 134, 585 (a) 
Turner, J What laymen can ask of scientists Science, 1961, 133, 1195 (b) 

Udow, a B The “interviewer effect” in public opinion and market research 
surveys Arch Psychol 1942,59 No 277 

Veroff, J Anxious first borns Contemp Psychol 1960,5 328-329 
Verplanck, W S The control of the content of conversation Reinforcement 
of statements of opinion J abnorm soc Psychol. 1955, 57 668-676 
Viiun-Kline, Linda L The effect of an experimenter’s perceived status on 
the mediation of experimenter bias Unpublished master’s thesis, Univer of 
North Dakota, 1962 

ViNACKE W E Laboratories and lives Paper read at Amer Psychol Ass , 
Chicago, September, 1965 

Wallach, M S , & Strupp, H H Psychotherapist’s clinical judgments and 
attitudes toward patients 7 consult Psychol. 1960,24.316-323 

subjects as a source of sampling bias Amer J Social 
1949,54 539-544 ^ ^ 

Walters, Caturyn, Parsons, O A , & Shurlev, J T Male female dif- 
sensory isolation Bril J Psychiat . 1964, 109-110, 

Walters, Cathryn, Shurley, J T, & Parsons, O A Differences m male 



434 


References 


Sullivan, H S A note on the implications of psychiatry, the study of inter- 
personal relations, for investigations m the social sciences Amer J Soaol , 

1936-37,42,848-861 

Summers, G F , & Hammonds, A D Toward a paradigm of respondent bias 
in survey research Unpublished paper, Univer of Wisconsin, 1965 
Symons, R T Specific experimenter subject personality variables pertinent to 
the influencing process in a verbal conditioning situation Unpublished doc- 
toral dissertation, Univer of Washington, 1964 
Symposium Survey on problems of interviewer cheating Int J Opin atlit 
Res 1947,7,93-106 

Taffel, C Anxiety and the conditioning of verbal behavior J abnorm soc 
Psychol. 1955, 57,496-501 

Taylor, Janet A A personality scale of manifest anxiety J abnorm soc 
Psychol , 1953, 48, 285-290 

Tolman, E C Purposive behavior in animals and men New York Century, 
1932 

Troffer, Suzanne A , & Tart, C T Experimenter bias in hypnotist per- 
formance Science, 1964,745, 1330-1331 
Tuddenham, R D The view from Hovland Headland Contemp Psychol , 
1960, 5. 150-151 

Tukey, j W Data analysis and the frontiers of geophysics Science, 1965, 
148, 1283-1289 

Turner, G C , & Coleman, J C Examiner influence on thematic appercep 
tiOQ test responses 7 proj Tech 1962,26,478-486 
Turner, J On being fair though one-sided Science, 1961,754,585 (a) 
Turner,! What laymen can ask of scientists Science, 1961,755, 1195 (b) 

Udow, a B The ‘ interviewer effect” m public opinion and market research 
surveys Arch Psychol, 1942, 59. No 277 

Veroff, j Anxious first borns Contemp Psychol . 1 960, 5, 328-329 
Verplanck, W S The control of the content of conversation Reinforcement 
of statements of opinion J abnorm soc Psychol, 1955,57, 668-676 
Vu^n-Kline, Linda L The effect of an experimenter’s perceived status on 
t e mediation of experimenter bias Unpublished master’s thesis, Univer of 
North Dakota, 1962 

ViNACKE W E Laboratories and lives Paper read at Amer Psychol Ass , 
Chicago, September, 1965 

Wallach, M S , & Strupp, H H Psychotherapist’s clinical judgments and 
attitudes toward patients 7 consult Psychol 1960,24 316-323 

^ Volunteer subjects as a source of sampling bias Amer J Sociol 
1949,54 539-544 ^ ^ 

Walters, Cathryn, Parsons, O A , & Shurley, J T Male female dif 
29^2^5 ^ 1964,709-770, 

Walters, Cathryn, Shurley, J T, & Parsons, O A Differences m male 



Inde% of Names 


Aas, A , 231 

Affleck, D C , 7 

Akock, W , 243 

Allen, S , 45 

AUport,F H,118 

Allport, G W. 129,270,407 

Anderson, M , 136 

Aronson, E, 203, 302,407, 408 

Asch, S E, 220, 231 

Aznn, N H , 31, 34 

Babich, F R » 368, 379 
Back, K W , 82 
Bacon, F, 380 
Bakan, D , 7, 35, 181. 322 
Baker, K H , 135, 143 
Baker, R A , 79 
Bales, R F, 49, 269 
Bandura, A , 115 
Barber, B , 18, 19 

Barber, T 5C,76, 132 g 

Barnard, P G , 63, 70, 92, 93, ll» 

Barzun, J , 212 

Bass, B M , 77 

Bass, M , 243 

Bateson, G , 270 

Bateson, M C , 404 

Bauch, M , 4 n 9 . 

Bean,W 8,6,7,21,26,28 

Beauchamp, K 

Beck,W S. 27, 28. 32, 212, 

Beecher, H K,367 
Beliak, L , 80 
Benney, M , 46, 57 
Berg, I A , 77 
Berger, A , 238 

Berger, D, 117 

Beringer. J B A , 2 
Berkowitz, H , 8o» 

Berkson, 1,5,31,312 
Bernstein, A ^,5^ 

Bernstein, L , 165, 178 
Bershad, M , 171 
Bessel, F W , 3 
Betz, B J , 407 
Binder, A , 42 


Binet, A,6, 29 

Bingham, ^ ^ ^ ’-^5 
Birdwhistell, R L , 23 

Bimcy, R 
Blake, R R*^^^ 

Blanc. HT, 407 
Blankenship, A H , iu 

Bloch, B E , 243 
Blondlot, 4, 27 

Boardman, ^ . ,4 18, 20, 24, 25, 

Bonng, E O . ' 

389 „ 

Brady, 3 

I 11,90,321 

Brogden, W J . 

Brown, I M . 82 

Brown,W.286 , 34 

Brunswik, E , 300, 

Bubash, S . 388, 3 9 

Bucttonl B 4^8,239 

Cahalan, D , 31. 352 
Cahen.E S , 22 

Cf'''«>%’gT,17.22, 132 
H G 60 

S"‘"'’?’/V'203.319. 302. 407. 408 

grn;EV!^56 

Carlson, R.^ 66 68, 75, 107, 124, 

^r9'r.93, 20^.353. 370 
Cervin, '' B • 

Chafelz, M ^ , 

Chapams,A,2 

ChapaniSj^N P. 375 

Christie, R 
Christy. E G.33' 

C|'"f^F,302.407 
Clapp. ”i_ ’,,3 


Clapp. ", ' 

Cla*.E E. • -(, 

Clark. 5 CB’ll 1,7 

Cleveland. S ,0 

Clyde. D 3* 


437 



436 


References 


WOLINS, L Needed Publication of negative results Amer Psychologist, 
1959, 14, 598 

WoLiNS, L Responsibility for raw data Amer Psychologist, 1962, 17, 657- 
658 

Wood, F G Pitfall Science, 1962,735, 261 

Woods, P J Some characteristics of journals and authors Amer. Psychologist, 
1961, 16, 699-701 

Wooster, H Basic research Science 1959, 730,126 

WusTER, C R , Bass, M , & Alcock, W A test of the proposition We want to 
be esteemed most by those we esteem most highly 7 abnorm soc Psychol , 
1961,63, 650-653 

Wyatt, D F , & Campbell, D T A study of interviewer bias as related to 
interviewers’ expectations and own opinions Int 7 Opin Attit Res, 1950, 
4, 77-83 

Young, R K Digit span as a function of the personality of the experimenter 
Amer Psychologist, 1959, 14, 375 (Abstract) 

Yule, G U On reading a scale 7 Roy statist Soc, 1927,90, 570-587 
Yule, G U , & Kendall, M G An introduction to the theory of statistics 
(14th ed ) New York Hafner, 1950 

Zelditch, M Role differentiation in the nuclear family A comparative study 
In T Parsons & R F Bales, Family, socialization and interaction process 
New York Free Press, 1955 Pp 307-351 
Zillio, Maria Einstellung und Aussage Z Psychol 1928, 106, 58-106 
(Translated by Irene Jenson ) 

ZiRKLE.C Citauon of fraudulent data Science, 1954, 720, 189-190 
ZiRKLE, C Pavlov’s beliefs Science 1958,728 1476 
Zirkle, C a conscience in conflict Book review in Science, I960, 132, 890 
^ ^ Some potential errors in conducting mental health research In 
T j ranson (Ed ), Report of the conference on mental health research 
Indianapolis Assoc Advance Ment Hlth Res Educ , 1959 
N^iECKi, F The social role of the man of knowledge New York Columbia 
Umver Press, 1940 



439 


Index of Names 

Greening, T C , 409 

SSK’loUzfi. 230, 259, 260. 
349,362 

Gruenberg, B C , 137 
Guilford, J P I 170 
Gunne, L M , 133 
Guthrie, E R , 130 

Haas, H , 367 
Halas, E S , 8 

Haley, J, 270 ^ ... 

Haky, S , 52, 54, 73, 86, 99, 124, 125, 
245,301,363 
Hammel, E A , 323 
Hammond, K R,333 
Hammonds, A D , 58 
Haner, C F , 235 
Hanley, C , 13 
Hanson, N R , 4 
Hanson, R H , 132 
Harari, C , 21 
Harmatz, M G , 42 
Harris. N, 357 

Hart, C W, 20, 22, 23, 30, 46, 58, 60. 
74, 113, 131, 132. 236, 305, 306, 307, 
311,331,357,358, 361.363 
HartfeWer, G . 367 
Harvey, O 1 , 302, 407 
Harvey, S M,131 
Hayes, A S , 404 
Heffcrlme, R F , 302 
Heilizer, F , 235 
Heme, R W , 133 
Hemzl,R,235 

Heller, K, 94, 95, 115, 116, 117, 133 

Kelson, H, 193,208,296 

Hicks, W M , 18 
Hilgard, E R , 155 
Hollenih, 129, 130 
Holz,W,31 
Homans, G C , 243 
Homme, L E , 167 
Homgfeld, G , 134 
Hood, 28 

Hovland C 1,56, 193, 208, 231, 243 

Howard, F H,311 

Howard, K , 238 

Hume, D , 380 

Hum, R G , 235 

Hum, M, 5, 31,312 

Hurwitz.W N,361 ^ 

Hyman, H H , 20 22, 23, 30, 46, 58, w, 
74 113, 131, 132, 236, 305, 307, 311. 
331, 337, 338, 357, 358, 361, 363 

Hmir, A A , 238 

R,7, 8, 178 


Jackson, D D , 270 
Jacobson, A , 368, 379 
Jacobson, A L, 368, 379 
Jacobson, L , 131, 410 
Jahn, M E , 28 
James, W , 212 
Jams, I L, 56, 231,235 
Jastrow, J , 129 
Jenness, A , 23 1 

S^J‘a,.^.215.2.9. 25.,355 

Johnson. H M , 177, 178, 179, 287 

Johnson, M L , 6 

Jones, E E.91,94, 181 

Jones, F P,380 

Jones, R H , 21 

Jordan, N , 24 

Joyner, R C , 235 

Kagan, J , 52, 56 
Kalischer, 287 

^arfe, ’8^.240, 241 

^:Sk,V48,55,67. 266,267,268 

Kaufman, R S , 11 

KSey^i^H,V, 363,408 
Kellogg W N . 38 , 404 

Kelly, G A. 407 
Kelman, H C , 4i5, 

Kelvrn, 18 
Kendall, M G , 5 

Kennedy, G L , 4 aj 2j6 

Kennedy, J L, n, > 

Kety, S S , 25 

Kimble, G A . 2^3 

King, S H , 117 

Kinnebrook, D . 3. 

Kinsey, A C, 363 

KlebanSl, S G . 80 

KleimGS >90 3^, ,2 ^5, 

'‘,oT'io4. ii5'>>’/^*S’S 45;2«; 
215 219, 221. 226. 230, 244, 

k 251 25^ 398,409 

Kn“kn,C , 404 ,5_ io7, 124, 

Kolstoe, R H , 



438 


Index of Names 


Cobb, W J . 20, 22, 23, 30. 46, 58, 60, 
74, 113, 131, 132, 236, 305, 307, 311, 
331,357, 358,361, 363 
Cochran, W G , 5 
Coffey, H S , 409 
Coffin,! E, 231, 243 
Cohen, L , 21 
Cohen, W, 23 5 
Colby, K M , 7 
Cole, D L , 243 
Coleman, J C , 90 
Coffins, M E,409 
Connelly, 30 
Conrad, H S,322 
Cook Marquis, P , 71, 118 
Cordaro, L , 7, 8, 178 
Correns, 19 
Crespi, L P , 31, 34 
Criswell,! H.180, 181 
Crow, L , 83, 84 

Crowne, D P , 65, 66, 67, 84. 192, 237 
Crurabaugh, J C,136 
Crutchfield, R S. 231, 235 
Culler, R L , 7 


Dailey, J M , 235 
Dailey, J M , 302, 408 
Darwin, C , 19 
Das.J P,78 
Davidson, K S , 56 
Davis,! D, 115, 117 
Delboeuf, J L R, 136,368 
Dember, W N , 17 
De Nike, L D , 182 
de Rubmi, E , 286, 287 
Deutsch, M , 409 
deVries, H , 19 
Dorcus, R M , 409 
Droletle, M E, 117 
Dulany.D E, 182 
Durea, M A , 80, 81 

Ebbinghaus, H , 136, 196 197, 202 208 
209, 372 ’ 

Eckler.A R,36l 
Edwards, A L , 86, 287 
Ehrenfreund, D , 159 
Ehrlich, J S , 56, 57, 73 
Einstein, A , 16, 17, 18 
Ekman, P , 75, 77 
Epps, E G,59 
Eriksen, C W , 182, 235 
Escalona, S K , 118 
Evans, A , 28 
Exline, R V , 48 
Eysenck, H 3 , 322 

Fechner, G T, 136 


Feinstein, A R , 6, 20 
Feinstem. S H , 404 

Feldman, J J , 20, 22, 23, 30, 46, 58, 60, 
74, 113, 131, 132, 236, 305, 307, 311, 
331,357, 358,361,363 
Felice, A , 378 
Fell, H B , 19 
Ferber, R , 218 
Ferguson, D C , 42 
Fcstinger.L,219, 407,408 
Filer, R M,21 
Fine.B J,235 
Fink, H , 367 

Fisher, R A , 5, 15, 19, 28, 322, 334 
Fode, K L, 12, 31, 145, 146, 147, 148, 
158, 182, 189, 197, 212, 215, 219, 221, 
230, 231, 233, 234, 251, 287. 289, 355, 
373 

Fortune, R , 22 
Foster, R J , 23 1 
Foster, W S , 286 
Frank. J . 133 
French.! R P.83,243 
Freud, S. 102. 139 

Friedman. C J , 12, 215, 219, 221, 251, 
355 


Friedman, N . 47, 49, 50. 55, 67, 181, 
266, 267, 268, 269, 352, 373 
Fnedman, P , 135 
Friesen, W V , 75. 77 
Fromm Reichmann, F , 133 
Fruchter, B , 222, 250 
Fuhrer, M , 231 
Funkenstein, D H , 1 17 


Gaito, J . 322 
Gantt, W H,38 
Garfield, S L , 7 
Garrett, H E , 32 
Geldard, F A , 404 
Gelfand, D M , 235 
George, W H , 14, 28 
Gerjuoy.L R , 235 
Gillispie, C C , 14 
Glaser, E M , 409 
Glucksberg. S , 77 
Goldberg, S , 235 
Goldfned, M R , 323 
Goldiamond, 1,31 
Gotdslem, A P , 133, 407, 409 
Goranson, R E , 77, 243 
Gordon, L V , 80, 81 
Graff. H F,212 
Graham, S R , 114, 115 
Gray, D , 48 
Greenblatl, M , 134 

Greenfield, P M , 64, 65, 66, 68, 75, 107, 
124, 190, 192, 204, 252, 370 



441 


Index of Names 

Parsons, T , 49, 269 
Pascal, B , 380 
Pasteur, L, 19 
Pavlov, 1 , 136, 137 
Pearson, K , 14, 15, 324 
P«.tr,380 ,03_ ,o4_ 

«0. 23|, m 
241 251. 253, 259, 260. 261, 28», Ji:’. 
362, 3 68, 398, 404, 409 

Pllugrath, 1 . 236, 237 
Pfungst, O, 38, 86. *”• 'f' 

177, 244, 259, 286, 301, 302 
Planck, M , 19 
Plateau, 1 , 136 
Platten, 30 . 

Polanyi, M , 17, 18, 19, 30 
Pomeroy, W B , 363 
Pnnee, A 1,75, 287 
Pritzker, L , 17 1 


Ratble, M , 135 
Rapp,D ■W,2l 
Rasmussen, 1 , 5, 

Raven, B H , 243 
Ravitz, L J , 404 
Rayleigb, 18 
Rarran, G , 137 
Rcdfield,R,22 
Reece, M M , 79. 84 
Reed, 30 
Reif,F,212 
Rhine, J B , 136, 282 
Rice, C E , 404 
Rice, S A , 131 

Rider, P R , 25 jOO, 102, 

Riecken, H W, 61, 98, 

181, 189, 190, 192,245,330 
Riesman, D , 46, 56, 57, 

Ring, K, 34, 363 
Ringuette, E L , 270 
Robinson, D , 60 
Robinson, J , 21 
Robinson, J M , 59 
Rodnick, E H , 80 
Roe, A, 14,211,212 
Roentgen, W K , 18 
Rohde, S , 60 

Rokeach, M , 13, 78, 244 349^ 

Rosenberg, M J , 61, 181« 

RoKntal D , ‘ 56 , 390. 393^^ ^ 

Rosenthal, R , 09 103, 104, 107, 

65. 66. 68, 72. 75. 86 89, lUJ, 

113, 124. 138. 139. 145. 158 219, 

189. 190 192, 197, 20 , 2 • 
^7?i;^2f3;r9;«r/6V.Ss:369^^^. 


287 289, 306, 322. 349, 355, 362, 368, 
370, 373, 378, 398, 407, 409 
Ross, S , 134 
Rostand, 1 . 4, 15, 27 
Rotter,! B, 21. 407 
Rozeboom, W W , 322 
Ruebush, B K , 56 
Russell, B , 179 

corVs. EE, 87, 89 

Sampson. EE, 83, 302, 

Sanders, R , 63, 71, 117 
Sanford, R N , 17 

Sapolsky.A,82 44, 62.63,70, 73, 

Sarason, I G, 42, 43, f^, 

74. 75,92. 235,236.409 
Sarason, S B . 7. 56 jg5^ 

Saslow, G * 

Saunders, F , 115, 112 
Schachter,S,68 3,9 251, 355 

Sehlll.T R,n.^‘ 

Schmeidler, G • 

Schuette, t> • - 
Schultz, D P 1^220 
Schulze, G , 348 
Sebeolt.T 

Semroelweis^lP gg 

Shapiro, A K, 134,4 

Shapiro, A P, 6. 47 

Sheffield, F D , 11 

Sherif.M. 193.208 

Shils, E A , 49 

Shinkinan.P G, 0 

Shor.R E.'SJj ,,6 
slbley-’^L B , 302,407 266 

Sjoholm,N A . 42 
Smart, R G, 322 

Smith, E E , 83 

Smith, HL,^ 54 

Snedecor.G W.iz 

Snow. C P .78 

SolomQU,R L^3^9 3j 

Spence, K ,52,238 

Spielberger, C D , 10 

SPiif’n^F ,35 !i43 

Stanton, F , -- 

Star, S A ,20. 46.^57^^ jg 60. 

Stember, C H , 2 ^ 236, 305, 307, 311, 
’^■..'»7.«\ 35^ 358. 361. 363 
Stcphe>is* ^ M ,17 

Sterling ^ P 

Stevens. S S , 136 gg^ 293 

Stevenson, « ► 



440 


Index of Name* 


Kramer, E , 132 

Krasner, L., 77, 90. 182, 191, 290 


Krugmati, A D , 134 
Kubie, L S , 7 
Kuethe, J L,235 
Kurland. 0,47,268,269 


Lamarck, J B P A M de, 29 
Lane, F W , 6 

Laszlo, J . 13, 77, 78. 79. 151, 152. 244 

Lawson, R , 3 1 , 165, 166 

Lcfkowitz, M , 243 

Leser, 6, 29 

Levin, S M , 184 

LeviU.E E.7. 132.367 

Lcvy.L H. 134 

Lewis, 0 , 22 

Liddell, H S . 38 

Lighthall. F F , 56 

Lmce.D L,77 

Lindquist, E F , 392, 394 

Lindzcy, G . 37, 135 

Lipsher.D H. 115 

Lister, J . 19 

London, P, 23 1 

Lord. E , 80 

Lubm, A , 323 

Luborsky, L , 133 

Luft, 1 , 80. 86 

Lyerly, S B . 134 

McClelland, D C , 56. 269 
Maccoby, E E , 113 
Maccoby, N , 113 
McConnell, D , 42 
McConnell, R, A, 118, 136 
MacCorquodalc, K , 37 
MacDougall, C D , 29 
McFall, R M , 209 

McGmgan, F J, 63, 82, 323, 333, 375 

Mackenzie, D , 28 

MacKinnon, D W , 130 

McNcmar, Q , 309, 322 

McTeer.W ,77 

Magath.T B, 5, 31,312 

Mahalanobis, P C , 31, 331 

Mahl, G F , 348 

Maier. N R F , 32, 86 

Mannheim, K , 211 

Marcia. 1 , 65, 154, 230, 308 

Marine, E L , 88 

Marks, E S , 132 

Marks,! B,409 

Marks, M R , 206 

Marlowe, D , 65, 66, 67, 84, 192, 237 
Marwit, S , 154 
Maskelyne, N , 3 


Masling. 3 , 46, 60, 79. 80, 95, 153, Wl, 
378 

Matararzo. J D , 77, 95, 115. 117, 184, 
185, 235 

Mausner, D , 243 
May. R. D . 322 
Mead, M , 22 
Meadow, A , 235 
Mendel. G .5. 19. 25,28 
Merlon, R K , 129, 132 
Michelson, 17 
Mill, 3 S,380 
Miller, D C, 18 
Miller. J G , 286 
Miller, P E., 115 
Mills,;, 219 
MiIls.T M. 181,330 
Mtimoc, S , 407 
Mmafd.J.43.70, 74,75 
Miniz. N . 99, 100 
Mo». A. 132. 179,28$ 

Moore, n V.212 
Motley, 17 
Morris, 19 
^^or^ow, W R . 26 
Moss. H J . 52. 56 

Mostellcr, F. 19, 60, 148, 312. 315, 323, 
325,335 

Mouton, J S , 243 
Milller. 6 

Muliy, R C, 63, 65, 69. 71, 72, 103, 
104, 107, 226, 230, 232, 240. 251, 253, 
259, 260, 261, 349, 362, 368, 398, 409 
Monger, M P,231 
Muno.N L., 165 
Murphy, G , 24 
Murray, H A . 21 
Myers, R A .94,95, 116, 117 

Naroll.F,311 
Natoll.R, 23, 311, 329,361 
Newcomb, T M , 240 
Newton, 1 , 3,4 
Nolungk.B E,28 
Norman, R D , 74 
Norrrs.R C, 218. 219 

O Connell, D C, 182 
Odom. R D . 43, 293 
O’Hara,) W,23l 

Ome, M T, 61. 84, 132, 133, 180, 181, 
182, 184, 195,220,330,369 
Orr.T B, 134 
Osten, von, 137 

Palmer, L R , 28 

Pareis, E N , 77, 117, 184, 185, 235 
Parsons, O A, 45, 46 



Subject Index 


Abnormal behavior, diagnosis, 20 
Absorption lines, 4 
Academic blooming, 410 ff. 

Accomplices, 94-97, 102, 160-161, 198- 
199, 202, 204, 205, 207-208, 392 
as experimenter, 97 
effects on experimenter, 97 
Achievement need, 77 
Acquaintanceship, see Experimenter, ac- 
quaintanceship 
Adaptation level, 22, 296 
Adsorption theory, 18 
A^air, The, 28 
Alcohol, 131 

Alcoholic, treatment and doctor’s voice, 
407 

American Documentation Institute, 323 
American Medical Association, 134 
American Physical Society, 18 
Animals, clever, 137, 379 
Anthropology, 311 
field reports, 329 
field research, 361 
Anti Semitism, 60 

Anxiety, 129, see also Experimenter, 
anxiety and Subject, anxiety 
eyelid conditioning, 24 
scores, 40, 41 
Apprehending error, 14 
Arapesb, 22 

Assessing community, 15 - 

Assessment bias, 131; see also specific 
experimenter effects 
Assimilation effects, 208 
Astronomy, 401 
Athletic activity, 113 
Atomic forces, 18 

Audience Research Institute, 113 

Auditory channel, see Expcnmcn » 
havior, auditory channel r«ncrl* 

Auditory plus visual channels# 
menter. behavior, visual plus audlforV 
channels mi 

Auihontananism, see Expcnm » 
thoritanan and Subject, author 
Authorship, multiple, 323 


Automated data collection systems (AD- 
CS), 333, 334, 375, 376 

Automobile dnvmg, 130 _ 

Awareness, and error control, 7, 14, 136, 

being influenced, 98, 101, 182, 184- 
186 

B coefficient, cluster analysis, 222, 251 
BaaAurtconPro 600 camera, 262 

Bank, failure, 132 
Barometer, 380 
Basal skin impedance, 59 

Behavior, forbidden, 56 

Behavioral sciences, 38j^J9 
intentional emr, 29 H 

interpreter effects, 20 II 

observer effects, / n ,,, ,22 125, 

Bending over backward, 121-122, 
218-220, 340, 370, 386 

Berkeley Rats, ^159^ Espeetancy ef- 

“Sis omfEspenmenter, bias ondDtpen- 

mentcr, expectancy 
balancing, 315 
distribution, 315 

resistance, 131 , ,pcclnncy cf- 

reverse, 218. see 

feels, reversed 



^wcrprrter effcil;. E' 
oluftvrr 

- 

Miiiid"; .,,1 hd 

llluik Vvii,"’ 

Ill.m4.uuul ' 

' 



442 


Index of Names 


StQuffer, S A , 148 
Stratton, G M , 286 
Strupp, H H , 7, 133 
Stumpf, C , 137 
Sullivan, D F , 235 
Sullivan, H S , 7 
Summers, G F , 58 
Symons, R T , 73 

Taffel, C , 64, 235 
Tamuloms, V , 31, 357 
Tart,C T, 155,289,363 
Taylor, I A , 63 
Thibaut,J W, 91,94 
Tolman, E C , 286, 407 
Trescott, 30 

Troffer,S A . 155, 289, 363 
Trosman, H , 133 
Tryon, R C , 166 
Tschermak, A , 19 
Tuddenham, R. D , 181 
Tukey, J W , 25 
Turner, G C , 90 
Turner, J , 26, 27 


Ulrich, R , 31 
Uphoff.H F,ll, 12 

Vemer.H W, 31. 357 

Vernon, P E , 270 

VeroR.J ,181 

VerpIanck.W S, 3 1,34 

Vikan Kline, L L {see Kline, L L V ) 

Vinacke,W E,389 

von Osten, 137 


Waite, R R , 56 
Wales, H G,218 
Wallach.M S,7 
Wallm, P , 90 
Wallen, C , 45, 46 
Walters, G C,323 
Waly, P , 59 
Ware,! R,79 


Warner, L , 135 

Wartenberg Ekren, U , 80 

Watson, D J , 5 

Weakland, J H , 270 

Weick, K E , 24, 153, 285, 292, 301 

Weiss, W , 243 

Weitzenhoffer, A M , 155 

Wernicke, C , 179, 286 

White, C R , 12, 193, 215, 219, 251, 355 

White, R, 136 

Whitman, R M , 190 

Whitman, R N , 79, 84 

Whitney, E R , 235 

Whyte, W F , 129 

Wiens, A N,95, 115 

Williams, F , 57 

Williams, J A , 57 

Williams, L P , 27 

Wilson, A B , 130 

Wilson. E B . 4, 25, 27, 203, 287, 367 

Winder, C L , 235 

Winer, B J . 394 

Winkel, G H , 62, 63 

Wirth,L,7,211 

Wolf, 1 , 407 

Wolf, I S , 322, 323 

Wolf, S, 19,20 

Wolf,T H, 29, 368 

Wolfle, D , 389 

Wolins.L, 13, 33, 323 

Wood, F G , 25 

Woods, P J , 323 

Woolf, D J , 28 

Wooster, H , 21 

Wustcr, C R , 243 

Wyatt, D F , 132 

Young, R K , 63 
Yule, G U , 4, 5, 15 

Zelditch, M , 49 
Zilhg, M , 17 
Zirkle.C, 19, 29. 137 
Zirklc,G A, 7 
Znaniecki, F , 19 



445 


Subject Index 

Counselor interviewer, 94, see also Ex- 
penmenter 
Creative ability, 130 
Crete, history, 28 

Criterion value, 13-15, see also True 
value 

Cue reading, ability, 286 ff 

Data, asymmetric, 313 
biased, 316-317, see also specific ex 
penmenter effects 
borrowing, 33-34 
common exchange system, 32 
contamination, 30, see also specific ex^ 
penmenter effects 
correct, 311, see also True value 
correlation of predicted and obtained, 
164,213-214,216 
creativity m interpretation, 35 
defined, 310 
destruction, 33 
discordant, 25 

discovery vs demonstration, 35-36 
duplication expense, 34 
early returns, 136, 196, 243, 312-313, 
372, 377, 392 
control, 245 
exciting, 35-36 
expected, 31 

fabrication, 29-30, see also Intentional 
error 

physics student lab, 3 1 
psychology student lab, 31 
taboos, 30 
‘ goodness,” 35 
Ignoring, 18-19 
inconsistent, 18,42 

interpretation, 325, see also Interpreter 
effect 

kurtosis, 313 
lending, 33-34 
open books policy, 33-34 
paradoxical, 18 
pleasing, 196-197 
pool, 25 

predicted and obtained, correlated, 164, 
213-214,216 
processing, 13 
purpose of collection, 3 1 
quality control, 23 
rejection, 25 
requests, 33-34 
[etracuon, 28 
“sacred,’ 31 
sharing, 33 
»ltewness,3l3 
suppressed, 17 
suppression. 19,26, 32,36 


behavioral science, 24-25 
surprising, 197 
transcription, 12 
unpopular, 25 
See also Observation 
Data collection, automated, see Auto 
mated data collection systems 
beliefs and values about, 363-364 
Data collector, see Experimenter 
Deception, 156—157, 388-389, 399 
cost utility, 157 
ethical questions, 347-348 
m science, 347 
style, 388-389 

Decision model, accept reject, 322, 371 
Dehoaxing, 389 
Dclenum tremens, 133 
Demand charactensUcs, 182, 191-lve, 
194-195, 330 
Depnvation, sensory, 45 

Design, representative, 306 

Destitution, industrial factors, lii 
Diagnosis, behavioral, 20 

Diagnostic categories, 20 
Differential treatment 
penmenter, behavior, differential treat 

ment 

Discrimination, racial, 58 
Dissonance reduction, 219, 25 
Divine Book, 27 
Divining rod, 286 
Doctoral candidates, 36 

contractual protection, 366 

Doctoral committees, « 

Doctoral dissertation proposal, 36 

Doctor’s voice, 407 

Dogs, 38, 137, 177- , 

audilory ’ 

discnmination ability, 28/ 

Dominant theory, 17 j2 

Don’t know survey r 
Double blind, 367 It , see 

and covert dtagnom 370 

and subject 553, 369, 370, 

cracking the code, 332, 353, 

Xuyn— 

empmcll 

rel«ant"ex4c«n=.k370lt 

Drive, hunger. 159 
level, 88—89 



444 


Subject Index 


Brief reports, 36, see also Publication 
policies 

California F Scale, 71, 72, 156 
Cancer, 6, 29, 134 
cures, 340 

Cardiac diagnosis, 6, 20 
Cardiology, 20 
Cell, 38 

Census Bureau, U S , 129 
Central relay systems, 14 
Central value, 13, 16, 17 
Charily, applicants, 131 
Cheating, 29, 31, 219, see also Inten 
tional error 
motives, 31 
problem, 29 
restraints, 219 
Chemistry, 38 
Cherry angioma, 6 
Children, disadvantaged, 130-131 
Chromosomes, 38 
Church, lessons, 59 
Civil Service, 115 

Clairvoyance, 286, see also Extrasensory 
perception 
Classroom, 408 

Clever Hans, 137-138, 143, 147, 150, 
177-178,244. 259,286, 301 
phenomenon, 293, see also Communi* 
cation and Expectancy effects and 
Expenmenter, expectancy 
Client, dependency, 133 
Clinical psychologist, modeling, 114, see 
also Experimenter, modeling 
Clinical psychology, 20, 114 
Clinician, faith, 134 
Cluster score, 81 

Coding error, 113, 338, see also Inter 
preter effect 
Coercion, 403 

Cognitive dissonance, theory, 219, 259 
Communication among psychiatric pa 
tients, 405 ff ^ 

interpersonal. 119, see also Commum 
cation channel and Experimenter, be 
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bending forward, 13/ 
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346,361, 397 

Editonal Board, Consumer Reports, 29 
Science, 29 

Editorial policies, 18, 24-25, 36-37 
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of one’s own behavior, 407 
interpersonal, 129. «e also Experi 
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motor control, 69 
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observer sex, 54 
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relaxed, 55, 93, 105, 126, 165, 174 
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self assurance, 64, 96 
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slow speaking, 105 
smiling, 47-49, 55, 66, 79, 84 
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solicitous, 79 
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tempo, 50-51 

tense, 64, 109, 126 

tone of voice, 55, 64, 67-68, 76, 

91, 105-106, 139 

variation, 61 

verbal activity, 100, 116 

v^,„aliChannieI, 5^^8;27bfl; 28811, 

4F4r"ior”2t’27Vff’; 

288ff,297ff 

vocal, 91, 123 

voice, enthusiastic, 90 
expressive, 54, 90 
pleasant, 54, 90 
v/arm 

expectancy 
controls, 331 fi 
defined, 311 
bias wise, 155 

birth order, 68 - 6 ^ ” 5 

character disorders, 4U3 

chivalry, 49, 56 
climate, 273 
socially 

task also Espennienter, 

cognitions, 154, see 
expectancy 

color perceiving. 57 . ,63 

competence. 49 50, 

consistency.3 
defined, 312 
constancy, 3/0 , 
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Expenmenter (Cont ) 

differential treatment {Cont ) 

140, 155, 165, 171, 174-177, 300, 
301, 375, see also Experimenter, ex- 
pectancy and behavior 
dominant, 64, 94, 105, 116-117 
encouraging 55,81 
enthusiastic, 66-67, 76, 107, 123, 165, 
174 

etiquette, 49 

expectancy effects of, 250 ff 
active, 257 
aloof, 255, 258 
anxious, 254 
arm movement, 255 
auditory variables, 273 ff 
body movement, 256, 268 
bored, 258 

businesslike, 252, 255, 258, 268 
channel discrepancy, 273 ff 
competent, 256-257 
consistent, 256-258 
courteous, 255 
differential emphasis, 254 
direct observations, 250 ff 
enthusiastic, 254, 258 
excessive movement, 256 
expressive voice, 253, 258 
filmed interaction, 280 
activity, 264-267 
clustered variables, 271 ff , 280 
competent, 280 
dominant, 264-266 
friendly, 264, 266 
formality, 280 
glancmg, 266-269 

instruction reading, accuracy. 266- 
269 

instruction reading, speed, 266-269 
likeable, 264-266, 280 
posture, 267 

professional, 264-266, 280 
relaxed, 280 
smiling, 266-267 
stimulus presentation, 267 
tone of voice, 180 
filmed observations, 259 ff 
head movement 253-254, 256, 258 
honest, 256-257 
important acting, 253, 257 
instruction period, 268 ff 
interest, 254, 258 
kinesic, 258 

leg movement, 253-254, 256, 258 
loud. 257 
modest, 257 
monotonous voice, 258 
nervous, 253-254 
nonpurposivc, 256 


overbearing, 257 
overenthusiastic, 254 
paralmguistic, 258 
personal, 255, 258 
professional, 232, 254-258, 268 
pushy, 257 
quiet, 257 

relaxed, 253-254, 258 
slow speaking, 254, 256, 258 
tense, 256, 258 
visual variables, 27 1 ff 
expected by subject, 82-86 
expressive, 76, 123 
expressive face, 66 
expressive tone, 76 

eye contact, 84, see also Expenmenter, 
behavior, glancmg 
eyebrow motion, 137 
facial expression, 69 
facial movement, 68 
fast speaking, 68, 106, 123 
fidgeting, 64 

filmed interactions, 54-55, 64, 66, 69- 
70, 72. 78, 86, 90-92, 105, 109, 
123,228, 262ff,282ff 
auditory channel, 270 ff 
observer reUabiUiy, 269-271, 278 
sample description, 260-262 
typical style, 264 
visual channel, 270 ff 
visual plus auditory channel, 270 ff 
finger activity, 84 
formality, 49 

friendly, 52, 54-55, 66, 80, 86, 94, 98, 
100, 116-117, 122, 124, 165, 174 
frivolous, 49 
general atmosphere, 139 
gestural inclination, 138 
gestures, 139 
glancing, 47-48, 75 
hand activity, 79 
hand movements, 147 
handling rats, 169 
happy, 82, 125 
head motion, 137 
honest, 55, 106 
imposing, 57 

independent variable, 399 
inferences, 352 ff 
qualitative bases, 355 ff 
quantitative bases, 352 ff 
influential, 106 

instruction period, 64, 78, 90, 92, 105, 
123 

mstrucuon reading 47-51,54,86 139 
accuracy, 93 
speed, 93 

interested, 76, 86, 93, 107, 123, 203 
involvement, 54, 93, 123 
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theones, 283 ff 

commumcauon channel, audito^. 

297 ff , see also Expenmenter, be 
havior, auditory channel 
visual, 297 ff , see also Expenmenter, 
behavior, visual channel 
visual plus auditory. 297 ff , see o so 
Expenmenter, behavior, visual plus 
auditory channels 
competence, 307-308 
confirmation, 96-98, 102, 196 , 

300-301 

conflict with subject, 193-194 
confounding with correlated attn- 
butes, 143 

control, 226, 331 ff . see also Expect 
ancy, control groups 

by awareness, 136, 247, 363 

by blind contact, 367 ff , see also 
Double blmd 
by blmd procedure, 153 
by blindness, craclaog the code, 332, 
353,369-370, 377 

by collaborative disagreement, 339 n 
by committee method, 339 ff 
by cue reduction, 137 
by cue resincuon, 245 
by maximizing, 380 ff 
by minimized contact, 374 ff 
evaluation of success, 398 
b> observation of behavior, 344 ff 
by observer presence, 349-351 
by personnel methods, 357 ff 
by sampling, 331 ff 
by sensory rcstnclion of cues, 178 
by special control groups, 156, 340- 
341 

by verbal admonition, 135 
double standard, 378-379 

delayed action, 201-202, 208 

disconfirmation, 96-98, 102, 196 ff, 
300-301 

experiments on, 143 ff 
expljcnness, 162-163, 214-215 
feedback on effect, 247-248 
fcnerahty. 158, 166, 194 
Etneralizability, 128 
»Jj<«yncratic. 398 
unnuniiy, 400 

induction 389 ff. see also Expect- 
ancy, induction , 

‘fiMructional behavior, differential 
e'nrhasis. 284 
Poi"iinE,284 
reeling errors, 284 
feiimg speed, 284 
reco'ding speed. 285 
^’x'Tncnng 284 


mtenlional influence, 247 
interpretation, 128 
measure, 223 

negative (reversed), 217-218, 295 
observation, 128 
permanence of effect, 171 
professionalness, 307-30S 
randomizauon, 331 ff 
revisions, 151-152, 226 ff , 230 
sources, 340 
and status, 307-308 
strenglhemog 196 

subject expectancy, compru^. 396 ff 
techniques of influence, 242-243. see 

also Commumcauon 
trend overtime, 171 
e“::r,tn.V93..5M60..67. 
261.268,311,367 
eipenenccs. 94, 109, 127 
face, 74 

fearsome, 102 
feedback rtstnction, 37/ 

"r?66V'2MJ]o; 

Sr^nd^micrp^^ona. en«.. 
fi,SV-U..cn37«78 

filming 

formality. 24, 2^ 

go„cral.aiiOTfrom.3» 
grades tamcil 146 
heailh, 138 

hontstf. 12. 34, 2.0 405-106 

hospitalized. ps> ' 74-73 

ho5lilit>. 40. " 

117,236 

o>crtness, ^ 

hypothesis. 215 
incenti'C 15 ,,0 

seenashri^0.2^^„_ 119 
mfioence. 38-4»- 
CO"’"'""'”';, 2S0 

unintended I '9. ,,4 

influt'’''’*'' 

insipoa 77 

inlegnly. >- , o', 109 1.4-'- 

mie"'?"’"- "■ 
intenl, 325 

livtsiaderl 1.0 . 

’06 ‘ lf.0 

hUrth'4 4*”-''^^ 
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Experimenter (Corvt ) 
correlated, 110, 323 ff 
criterion, 316, 318 

cues to subject, 147, see also Experi- 
menter, behavior 
auditory, 136, 177-179 
olfactory, 178-179 
restriction, 376-377 
tactual, 169, 178-179 
visual, 177-179 

differences, 8, 34, 38-39, 44, 60, 312, 
398 

differential treatment, 45-47, see also 
Experimenter, behavior, differential 
treatment 
disturbance, 118 
disturbed, 63 

dominance, 57, 73, 75, 78 
doubts, 118 
dress, 77, 110, 242 
white coat, 99 
effect, active, 40-41, 46-47 
and experimenter experience, 307-308 
assessment, 310 ^ 
choice of design, 135 
choice of procedure, 135 
constancy, 110 
control, by cancellation, 110 
by replication, 111 
defined, 310 
generality, 306 ff 
means, 110 
mean differences, 1 10 
passive, 40-42, 46^-47 
efficiency, 315 
ego involved, 261-262 
engineering student, 147-148, 306, see 
also Experimenter, sampling 
error, 310, see also Experimenter, effect 
evaluation, favorable, 107-108, 124- 
125 

unfavorable, 107-108, 124-125 
excessive rewards, 122, 151, 211 ff 
expectancy, 59, 96-98, 102, 104, 106, 
120, 123, 127 ff , see also Expectancy 
and Expectancy effect 
affected by subject, 196 ff 
and behavior 223, 243, see also Ex 
perimenter, behavior 
accepting, 243 

auditory cues, 288 ff , see also Ex 
perimenter, behavior, auditory 
channel 
consistent. 298 
cool, 243 

differential emphasis, 243 
differential treatment, active, 295- 
296 


casual, 299 
clear speech, 298 
courteous, 298 
dishonest, 298, 300 
dominant, 295-298, 300 
friendly, 295 
hand gestures, 298 
important, 298 
likeable, 295-296, 299 
loud speech, 298 
professional, 295, 297-298 
talkative, 298 
trunk activity, 298 
eye contact, 285 
eyebrow movements, 286, 293 
friendly, 243 
hand movements, 223 
head movements, 223, 286, 293 
interested, 223, 243 
leg movements, 223 
likeable. 223 
muscle tonus, 287 
nosinl dilation, 286, 293 
peculiar, 289 
personal, 223 
pleasant, 243 
posture, 287 

respiratory changes, 287 
slow-speaking, 223 
smiling, 243 
tone of voice, 223 
unfriendly, 289 

visual cues, 288 ff , see also Experi 
menter, behavior, visual channel 
visual plus auditory cues, 288 ff , see 
also Experimenter, behavior, visual 
plus auditory channels 
and experimental design, 127 
and experimental experience, 362 
and procedure consciousness, 362 
and subject attributes, 226 ff 
awareness as control, 136, 247, 363 
bending over backward, 121-122, 
125, 218-220, 340, 370, 386 
calibration, 331 ff 
changes in, 151-152, 226 ff , 230 
choice of procedure, 127 
choice of statistical tests, 128 
climates favoring effects, 169, 172, 
176 

communication. 154, 281 ff , see also 
Communication 

to animal subjects, 164-165, 176- 
178 

communication, extrasensory percep- 
tion 282,286 
intentional, 281 ff 
localization, 289 ff 
signal specification, 293 ff 
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statement of expectancy, 160 

status, 40, 73-78, 86-87, 95- ^6, 102- 
103,110,113, 150, 152, 156, 301 
academic, 241 a ^ca 

and expectancy effects, 241 ff , 254 
stimulus handling, 147 
stimulus value, 333, 378, see also Ex- 
penmenter, attributes and Expen- 
menter, behavior 
student, 31 
subject contact, 43 
subject distance, 51 
subject’s view, attractiveness, 190 
dental condition, 190 
dress, 190 
exploitative, 191 
eyeglasses, 190 
facial blemishes, 190 
incompetent, 191 
nonlherapeutic, 191 
posture, 190 
sadistic, 191 
seductive, 191 
unscrupulous, 191 
supervision, 158 

surprise, 40 a a in 

suspiciousness of being studied, n* 
101, 121-122, 176, see also Aware- 
ness 

sympathy for subject, 98, 237 
tape recorded presentation, 376-378 
tash-oriented, 73 
task performance, 65 
telephoned presentation, 377 
televised presentation, 376-378 
tension, 64, 125 

training, 361 ff, 399, see also Experi- 
menter, experience 
amount, 361 ff 
type, 362 ff 

underconsistcnt, 312-313 
undergraduate, 308 

unintended communication, see Com- 
munication 

Wcrance, content, 117 
duration. 95, 117 « 

variation. 8, 34, 38-39, 44, 60, 3l** 
398 

«nal order, 374 
View of experiments, 175 
'^ncficial, 175 
difFicult, 175 
‘ntcrcsting. 175 

v^armup, 155 

'armth. 40, 42-43, 55, 74, 79, 80-90 
94,98 

role played, 80 
'^rk sampling. 358 ff 


Experiments, analyzed for time trends, 
352 ff 

correlated, 153 

filmed, 47, see also Expenmenter, be- 
havior, filmed interactions 
subdivided, 332-333, 352 ff 

Exploratory research. 127 

Extrasensory perception (“r'- 
118, 135-136,282,340,379 
believer (sheep), 118, 136 
clairvoyance, 379 
disbelievers (goats), 118, uo 
psychophysics, 135-136 
recording error, 11 

F.,1....P=T. 

74 

Feedback effects, 109 . 

95 47 see also 

Flatworms, 7-11.1 1',^^ Clever Hans 

Foot tapping. 137, sr 

Fossils, 27 4(50 Intentional 

Fraud, 4, 4/, i-' » 
error 

Galvanic skin res^ma. 59 

g:;Sa?::ra^--a^aets,.^ 

30611 

GenSred interpreter. 16 

gSrSrch..03 

gr4r;.c&a\ory 
Greeting, subject, 
cation 

Hawthorne e 

"'^-r/rre oho intenucne. error 

Hoax. 27. ox. 

sSss==»“- 



Experimenter (Coni ) 

male, 40-55, 57, 62, 64-65, 80, 104, 
113, 145-*147, 151, 166, 182, 197, 
202, 215, 227-228, 230-233, 241- 
242, 245, 260, 268. 270, 287, 306, 
368 

influence and task orientation, 269 
size, 42 

marine officer, 42 
military, 74-75 
model of humans, 39 
modeling, 112-126. 132. 337, 341 
clinical psychology, 114-119 
control, 395 
by replication, 126 
laboratory experiments, 118-126 
survey research, 112-114, 119, 121, 
125 

modesty, 51 

monitoring 12, 344 ff, 349-351 
mood. 165. 203-204, 206 
molwes. 165, 168-169, 211 ff 
for deception, 389 
movement perceiving, 114-115 
name, 60 

natural science student, 120, 122-123, 
125, 245 ff , 306, see also Expert 
menter, sampling 
need for approval, 40, 65-68, 71 
and anxiety, 238-239 
and expectancy effects, 237 ff 
Negro, 58-59 
neurotic, 405-406 
neutral behavior, 42 
new profession, 364 ff , 400 
no nonsense, 73 
objective, 73 

observation, 47, 344 ff , 399 
method, colleague observers, 347 
experimenter as own observer, 349 
expert observers, 346-347 
mechanical observers 347-349 
principal investigator observers, 347 
represenlalwe observers, 347 
special occupation observers, 347 
subject observers, 345-346 
molar vs molecular, 348-349 
reliability, 348-349 
occupation, 138 
operating characteristics, 310 ff 
typology, 3 14-3 15 
opinion, 113 

overconsisient, 312-313, 315 
paragon, 313 
paranoid, 405-406 
patient, psychiatric, 405-406 
pay, 145, 151 
peicewci \eatVjCT, 85 


Subject Index 

perception of animal subjects, bnght, 
165, 174, 178 
likeable, 165, 174 
pleasant, 165, 174, 178 
personality, 207-208, see also Expert 
menter, attnbutes and Experimenter, 
behavior 

physical attributes, 61 
‘ poker and pryer,” 102 
practice, 11, see also Experimenter, 
expenence 

praised, 102-103, 107, 204-205 
prediction of obtained data, 213-214, 
216 

presence, 40-41, 43, 378 
prestige, 43, 70, 74-75, 96, see also 
Experimenter, status 
pnor contact with subject, see Expen 
menter. acquaintanceship 
procedure conscious, 261-262 
procedure, programmed, 116-117, 119 
projection, 98 
pushy, 73 

race, 40, 42, 57-60 
religion, 40, 60-61 

reproved, 102-103, I06-I07, 204-205 
reputation, 355-356 
reward, 151 
excessive, 211 ff , 386 
sampling, 60, 67, 75, 110, 113, 122, 
126, 306ff. 313, 331 ff. 372, 392, 
398 

cancellation of biases, 335 ff 
expectancies determinable, 341 ff , see 
also Expectancy determination 
expectancies known, 339 ff 
expectancies unknown, 334 ff 
generalizability, 333 
homogeneity of results, 338 
population charactenstics, 334-335 
satisfaction, 165, 173-174 
schizophrenic, 405-406 
screening from subject, 376-377 
selection 357 ff 
sample experiments, 358 ff 
self perception, 71 
serious, 122 

seriousness of role taking, lOI 
sex, 40-52, 54, 56-57, 61, 65, 70, 1 13- 
114, 127-128, 138, 156, 274, 293 
and expectancy effects, 226 ff 
interpersonal style, 269 
similarity to subject, 236 
simultaneous subject contacts, 332, 
372-374. 400 
skin color, 40-42, 57-60 
social class, 56-57 
spealcing time, 115 
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Subject Index 


suspicions, 33 
taboos, 30 

theory bolstenng, 32 

Interaction, social, m experiments, 39, 

401, see also Communication and tx- 
penmenter, behavior 

implicit theories, 256 

minimal, 41, 43, see also Communi- 
cation - 4 , 

Interaction, statistical, 43-48, 50, 5^ 58, 
62-63, 65, 70, 72, 74-75, 80, 83. 88. 

104, 110-111, 128, 193, 202, 206, 210, 

219, 228-229, 235-236, 238-239, 353, 

381 ff , 405 , j 

International Journal of Attitude an 
Opinion Research, 30 

Interpreter effect, 6, 14, 16 ff, 113, 13 » 
212,338 

anthropology, 22-23 
awareness, 25 
behavioral sciences, 20 ff 
biological sciences, 19-20 
characteristics of interpreter, 23 
control, 25-26 
culture assessment, 22-23 
diagnosis, 20-21 
education, 22 
expectation, 19 
experimental psychology, 24 
intentional enor, 28 
physical sciences, 17-19 
research assistant, 28 
school, 22 

sex of interpreter, 22 
survey research, 23-24 
test scoring, 22 

Interpreter, error, 131, 150, 158, 358, see 
°ho Interpreter effect 
generalized, 16 

Interventionist, political, 23-24 
Interview, anatomy, 115 
Interviewer, 
characteristics, 30 

cheating, 30, see also Intentional error 
compared to experimenter, 307, 35 - 
358 

competence, 357 
and bias, 361 
<xpcnence, 31 
honesty, 30 

Ideology bias, see Expenmcnicr, 

*nodchng 

Opinion bias, sec Experimenter, mooci- 

inc 


Japanese, perception of, 58 
Jews, attitudes toward, 60 
Journal of Consulting Psychology. 36 
Journal of Negative Results. 323 
Journal of the Royal Statistical Society, 

Journal policies, see Publication policies 


^fe also Expenmenter 
a*a laboratory, 24 
I"'clUgcnce 

‘'^‘^“onm. political, 23-24 


Kilohms, 59 . i *ieo 

Kincsic, communication channel, 258, see 
also Communication 
Knossos, excavation, 28 
Kodak Tn-X Reversal Film, 262 
Krebiozen, 134 

anfuxpeut!ncy effects, 245 ft 

appeurance, 99 
beautified, 99 
clattered, 101 
comlortahle, 99-101 
disordered, 99, 101 

mterogeography, I5U 

professional, 99-100 
bating rehabihty, 246 

severely furnished, 101 
status, 99 
stereotype, lot 

uglified, 99 , 

courses , teach,n|, 3^ „2 

instructor, 35 an. 
technicians, 31 j37 

Lamarckian '’ypn*'''* . " 

Lan’rence of Arch'd 

Laws, learning, 29, ‘“j 

a„dawareness,^182 
complex* I51_162 

curve, tn®"" ° ,59 , 162 
discrimination. '5 

»8i ,5, 

Simple*®® 

Skmnerbox, 165 ,, ^ 

theory, 88-»9. o/m 

verbal. 42-90. 
condilioning 5 j 

speed. H I68 

stimulus. ®' i 


log 


, snowy. 
function, 
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Horses, 38, see also Clever Hans 
Hostility, experimenter, see Experimenter, 
hostility 

subject, see Subject hostility 
vocal and psychotherapy, 407 
Hullian theory, 88, 219 
Human Interaction Research Institute, 
409 

Hy scale (MMPI), 82 
Hypnosis, 76, 132-133, 155-156, 182, 
289, 368, 390 
catalepsy, 182 
conformity, 390 
induction, 155 
research, double-blind, 368 
Hypnotist expectancy, 132-133, see also 
Experimenter, expectancy 
Hypothesis, 4, 13, see also Expectancy 
revision, 196 ff 
strengthening, 196 
Hysteresis, 95 

Iatrogenesis, 133 
Ideology and Utopia, 211 
Ideology bias, see Experimenter, model 
mg 

Impotence, 132 
Impression formation, 131 
India ink, hoax, 29 

Individual differences, 39, see also Ex 
penmenter, differences 
Industry, 408 
Inference, biased, 316 ff 
cost vs utility, 319 
errors, Type I, 322 

errors. Type 11, 322r-323, 351, 370-371, 
374 

plausibility, 329 
Inferential models, 321 ff 
Influence, experimenter, 38-39, 76-77, 
119, see also Communication 
intentional vs unintentional, 280 
interpersonal, as tacit knowledge, 301 
unintended, 40 

Informant, ill, see also Subject 
Information channel, see Communication 
Inheritance, acquired characteristics 29 
137 

Ink blot test, 63, 80, 86, 117, 153-154, 
see also Rorschach test 
animal percepts, 153 
Holtzman's, 154 
human percepts, 153 
Insomnia, 132 

Institute for Sex Research, 363 
Instructions, to subjects, 43, 47-51, 56, 
62-63, 119, 139, see also Expenmentcr, 
behavior and Tasks 


Instructor, laboratory, 35-36, 169, 172 

Instrument, error, 3 1 

Intelligence, 22 45, 80, 87-89, 130-131, 
409 ff 

experimenter, 72-73, 107, 109, 124-125 
test, 59. 63, 72, 80-81, 84-89, 95, 139, 
410 ff 

nonverbal, 410 ff 

Intentional error, 10, 14, 27 ff , 150, 158, 
163, 165, 169,219 
acceptance, 35 
accusations, 33 
and observer effect, 28 
anthropology, 28-29 
apocryphal, 32 
archaeology, 28 
awareness, 35 
behavioral sciences, 29 f! 
biological sciences, 28-29 
causes, 31, 34-35 
cephalometric, 29 
cheater problem, 29 
consequences, 28, 32 
control, 33 ff 
by entrapment, 32 
by observation, 213, 228 
by prevention, 34 ff 
by replication, 29, 34 
data suppression, 32 
detection, 33 
doctoral dissertation, 28 
expose, 29 
fear motive, 32 
geology, 27-28 
gerontology, 33 
incompetence, 33 

indictment, federal government, 29 

interviewers, 29 ff 

morale, 34 

motive, 27, 32, 34 

paleontology, 27-28 

physical anthropology, 29 

physical sciences, 27-28 

plant breeding, 28 

predictability, 30 

reputation, 30 

research assistant, 27-29, 34 
sampling bias, 33 
sanctions, 35 
schoolboy prank, 27 
second chance, 30, 33 
self-serving, 32 
shades of gray, 32 
social implications, 33 
student, 31-32, 35 
characteristics, 31 
grades, 3 1 

survey research, 29-31, 33 
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locaUon, 14 

national charactenstics, 17^ 

professional vs amateur, 3ol 
sensitive, 212 

set, 35 , also Observer, effect 
skill, 35 
student, 35 
training, 15 

Octopus, research, 6 

Ohio State University, 165-166, Juv 
Olfaction, 404 

One way vision mirrors, 40, 30y 
Opinion bias, see Experimenter, modeling 
Orange juice experiment, 118 
Ordinal position of birth, see Birth order 
Organization, conservative vs liberal, 
Orthodoxy in science, 18-19 
Outcome-consciousness, 35-36 
Outcome-onentation, 11-12 

Pan Cinor ‘ zoom” lens, 262 
Paralmguistic communication channe , 
258, see also Communication 
Paralysis, hystencal, 132 
Parameter estimation, 110 
Paranoid patients, 139 

Parapsychology, 135, 379, see also Extra- 
sensory perception 
Parental standards, 56 
Participant observation, 346 
Patient, expectation, 133-134, see also 
Subject, expectation 
faith, 134 
hope, 134 
hostility, 115 
psychotherapy, 115 

Payola. 218 

Perception, need determined, 17 
Person perception, see Task, person per- 
ception 

‘’“"-onal equation, 3 
nthropology, 22 
wnality, assessment, 46 
»ts, standardized, 95 fT , see also spe- 
ci/lc tests 
■suasion, 403 

armacology, blind research, 367 n , 


Physiological Congress, Thirteenth Inter- 
national, 137 
Pigs, clever, 137 
Pilot study, 365 
PiUdown man, 27 
Placebo, 134 

control groups, 388 

research, 367 no_i70 

Planana, behavior change, 7-11, 

Porpoises, relationship to expenmente , 

Power function, 136 

Prediction intprfVOTent, liu 
Prejudice, racial, 58, 132, 18» 
religious, 132 

Presidential campai^, 13Z 

Prestige, scientific, 1^1» ioi-107. 

Principal inve^gato , 40, ,^205^ 

307:332, 346, 

by early returns, 210 

anxiety, '03, 106 

— lS'l^-yefiect. 252- 

253 

pleasant, 125 

bir’^'to'rteatment eondiuons, 198. 
e^S^^renwtlh sublet, 346 

153 

expectancy, 153 

expenence ol, „,_373 

leedbe^h avoidance, 372 

Sldurd.fiercnc«.^“3-;“^^^^^^ 

irr.07"’ 

male, 104 p- 

need for ,07, 204-205 

praise from^, 1 ^„rnenler, 10-' 

relalionship to ext* 

'05, 'O’ 102-103, l06->02, 

rproof trom, 102->»^' 


enoij-pc, 5 

dology, comparative, 28 

ratings. 75, 99, see also Task, per- 
son jyrception 

^)sical sciences, intentional error, 27- 

*^frpretcr effects, 17-19 
®Hcrvcr effects. 3-4 
=nics.38 


f-incv elTccf' 232-255 

unintended w^ tfrom, 210 

unintentional 

prismauc I'^ilical. 32- 
!:;^:Ju^ddl«en^.3^ 

p|«edural error. 31 



456 


Subject Index 


Mail survey, 378 

Marlowe Crowne Social Desirability 
Scale (M-C SD). 65, 96, 183, 192, 238- 
239 

Maze, experience, 160 
learning, in rats, 158 ft 
Maze bright, rats, 159 ff 
Maze dull, rats, 159 ff 
Mean, biased, 312-313 
reliability, 312 
true, see True value 
Means, differences, 24, 110 
Memory, digit, 63 
research, 136 
Mendelian ratio, S 
Mental matrix, 25 
Menial retardation, 409 
Method of concomitant variation, Mills, 
380 

Method of difference. Mill s, 380 
Mice, 137 

Michelson Morley expenment, 17 
Microphone, 309 
Microscope, 401 
Military, setting, research, 102 
selection, 20 

Minnesota Multiphasic Personality In 
ventory (MMPl), 82, 405 
Mixed company, research dyads, 46 
Modeling effect, see Experimenter model 
mg 

negative, 113 
Moderator vanable, 206 
Monitoring, experimenter, see Expen 
menter, monitonng 
Morale, 34, 129 
Motion, eanh, 17 
picture plots, 113 
Muscle reading, 379 
cues m, 286-287 

N rays, 4-5, 15, 27 

National Opinion Research Center, 82 
364 

National policy, attitudes, 110 
National Science Foundation, Under 
graduate Research Participation Pro 
gram, 308 
Nausea, 132 
Near East, history, 28 
Negative instances, 329 
Negative results, 25, 36 
Nonpresent other, as influencer, 409-410 
Nonrandom error, see Bias 
Normal distribution, 313, 319 
Noyes food pellets, 167 
Null hypothesis, 128 


decision procedure, 322, 371 
iJursery school, 21, 87 
jJutntion research, 21 
nutritional diagnosis, 7, 21 

Obesity, diagnosis, 21 
Observation, angle, 14 
ignored, 17-19 
m science, 305 

of experimenter, see Experimenter, 
monitoring and Experimenter, obser- 
vation 

public vs private, 25 
Quality Index, 329 
situation, 14-15 
Observer, American, 179 
and observed, 7 

bias, 13, see also Observer, effect 
digit preference, 4 
observer experience, 8 
physical anthropology, 6 
research assistant, 6 
sampling plant heights, 5 
calibration, 212 
characteristics, 4, 14, 179 
correlated, 324 
efrect,3 ff , 17, 106, 113, 178 
agricultural statistics, 5 
and expectancy, 7-8, 21 
astronomy, 3 
awareness, 35 
behavioral sciences, 7 ff 
biological sciences, 4 ff 
blind spots, 7 
control, 14-15 
by calibration, 6 
by instrumentation, 4-5 
by mechanization, 14-15 
by replication, 15 
by training, 15 
experimental conditions, 8 
experimental genetics, 5 
generality, 3, 13 
medicine, 4 

nutritional diagnosis, 7 
physical sciences, 3-4 
planaria research, 7 ff 
psychiatry, 7 
psychotherapy, 7 
radiology, 6 
scale reading, 4 
social sciences, 7 
theory determined, 17 
error, 14, 20, 113, 150, 158, 179, 281, 
321, 358, also Observer, effect 
expcncnce, 38 
German, 179 
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Reliability, diagnosis, 20-21 
tests, 95-96 

Religion, experimenter, 40, oU-oi 

4irr;“ 29. 34. in 126 128. 
145-148. 153. 156. 158. 166. 236. 247. 
319-330. 331 11.390 
anecdotal, 328 ff 
assessment, 325 ff 
conflictmg, 327 
control of error, 29 
correlated, 323 ff 
index, 326 ff 
nature, 29 
publication, 323 
relative, 321 
shortage, 321 ff 
situational uniformity, 236 
status lack, 323 
successful, 34 

Representative design, 226, 306 
Research, blind evaluation, 37 
contract, 365 
design, biased, 128 
exploratory, 127 
funding, 37 
grants, 103 
groups, 101, 324 ff 
military setting, 74-75 
procedure, biased, 128 
proposal, 36-37 
quality, evaluated, 36-37 
quality, predicted, 37 
sponsorship, 74-75 
subject, see Subject 
support, 37 
teams, 101 , 324 ff 
correlated membership, 324 ff 
test Validity, construct vs criterion, 134 
time of year, 309 
undergraduate programs, 308 
research assistant, 6, 103, 106, 156, 160- 

SS’ ^^2-233, 252-253, 307-308, 368- 
■’W, 390, 393, 400, see also Principal 

'"vestigator 

influenced by principal investigator, 
232-233 


j^trainer attributes, 252-253 

Pondent, see Interviewer and Subject 
se. availability, 88 
defined, 310 

see Subject 
knowledge by, 305 
^erse bias, 214 ff 
academic. 35 
J^-d.v,mng.286,379 
terninine, 49 
'u^sculine, 49 


and body activity, 52 
sex, differentiation, 49 _ ^ . 

Rorschach test, 63, 71, 80, 114, 117, 134, 
153-154, see also Ink blot test 
anxiety, 1 17 
hostility, 117 
popular percepts, 117 
validity, 134 

white space response, 117 

Rosa, clever mare. 137. see also Clever 
Hans 

Russian city, evaluation. 22 

Saline solution. 134 
Samnlc size and statistical power. 24 
lamplmrand generality, sec Ecological 
validity and Experimenter, sampling and 

SuuauLsamphng and Subject, sampling 

biased. 33. 60. 112 

difference. 24. 29. 3 1. 34 

incompetent. 33 
theory, sophistication, 17b 
Scapegoat, 73 
Schizophrenic speech, 16 

Science, 33, 36, 137 ^ ^ 

"40?3°79!rcrnto Ext'rasensory per- 

“e'res, laboratory, 31, 35-36 

life styles, 36 

objectivity, 212 

orthodoxy, 18-19 
public nature, 25-2b, ize. 
self-correcting, 34 
trust, essential, 33 
vs Science-Fair, 36 
Scientific Prototype Co 16/ 

Scientific smturc, 18-1^9^ 

"'xee’n/soEx’perimenter 

academic affiliation, 37 
calibration. 6 

career, 30 

characteristics, . jn 

commitment to hypothesis, z 

education. 30 

evaluated, 37 
experience, 3U-3i 

faith, 33 
integrity. 28 

intelligence, 49 ^ 30 

interviewer compare 
motives, 26, 21 

^=SSoi!3M7 

SecmSol the interior,. 30 


Sedentary 


01 * , IQ 

occupations, 
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Procedure, consciousness, 35-37, 366 
consciousness, experimcnler, 1Q4-106, 
109 

evaluation, 36-37 

Professional experimenters, new profes- 
sion, 364 ff 
Prognosis, 133 

Prohibitionist, interviewer, 131 
Projection, defense mechanism, 139 
hypothesis, 98 
psychoanalytic, 102 

Projective methods, 46, 79-80, 86, 189, 
see also Ink blot test and Task 
Projective questions, 56 
Pronouns, first person, 43, 70, 75, 82, 89, 
108, 124, see also Task, sentence con 
struction 
Propaganda, 403 

Prophecy, self fulfilling, 129-133, 138, 
156, 226, 407 ff , see also Experimenter, 
expectancy 

Psychiatric, classification, 14 
disorder, 133 

patients, as subjects, 88-89 
Psychiatry, 20 

Psychoanalytic theory, 45, 73 
Psychokinesis, 11, see also Extrasensory 
perception 

Psychologicaf Abstracts, 313 
Psychologtcal BuUettn, 325 
Psychological diagnosis, 21 
Psychopharmacology, 109 
Psychophysical relationship, log vs power 
function, 136 

Psychophysics research, 109, 135-136 
Psychosis, 33 

Psychotherapist, selection for uninten 
tional influence pattern, 407 
Psychotherapy, 114-115,403, 406-409 
by other patients, 406 
duration and expectancy, 133 
Pt scale (MMPI), 82 
Public opinion research, 60, see also 
Interviewer 

Publication policies, 18, 24-25, 36-37 

Quality control, data, 23 

Journal of Studies on Alcohol. 

Rabbits, learning speed, 10-11, 90 
Race, experimenter, 40, 42, 57-60 
subject, 58-59 
Random error, 4 
Random numbers, 5 
Random sampling, 5 
Rapport, 311 
Rats, age, 159 


albino, 158 ff 

behavior and learning, 38, 158 ff 
“Berkeley,” 159 
cue sensitivity, 165 
auditory, 165 
olfactory, 165 
tactual, 165 
visual, 165 
female, 159, 166 
generalization from, 308 
handling, 38, 160, 165, 173-174, 178 
male, 159 

maze learning reputation, 159 ff 
sex, 159, 166 
speed of responding, 162 
Sprague-Dawley, 158 ff , 308 
Reaction, chemical, 38 
Recording error, 10-14, 113, 131, 150- 
151, 158, 163, 215, 245, 281, 321, 358, 
377 

control by self-recording, 245 
Records, official, 311 
Referees, journals, 36-37, see also Pub 
lication policies 

Reinforcement, 31, 43-45, 64, 70, 74-77, 
82, 88, 91, 107-108, 124, 154-155, 167- 
168, 174-175, 183, 188, 203, 252, 257, 
284 ff, 287, 289 ff, 302, 372, 407-408 
appropriate, 175 
babies, 118 
blue light, 43 

by expectancy confirmation, 203, 302, 
407-408 

by picture viewing, 43 
by principal investigator, 372, see also 
Principal investigator 
compliments, 44, 45, 88 
data recording, 287 
effectiveness, 43, 74-75, 108 
food pellets, 167 

good,' 43, 64, 70, 75, 82, 91, 107, 
124, 252, 257 
of photo judging, 85, 183 
pattern as function of subject sex, 284 
pen scratch, 287 
rapid, 175 
secondary, 168 
subtlety, 188 
tactual, 174-175 

theory of expectancy communication, 
284ff,289ff 
'um hum,” 91 

unintended, 154-155, see also Commu- 
nication channel 
value of acquaintances, 302 
verbal, 43-45, 64, 70, 74-77, 82, 88. 
91. 107, 124, 252,257 
Relativity theory, 16-18 



461 


Subject Index 


communication among, 192 
competence, 86 

“;S?:^riS-LuimSubicct.con. 
formity ^ 

concept formanon 60 

conformity, 66, 71,^^ 

isS; /cc uto 

legitimation by experime 
258 

motivation, 218 
by experimenter style, 258 
confusion, 277 
course credit, 145, 147 
deception of, see De«ption y, 

description of experimenter, 

222, 225, 259 ff. 

desire to please, ‘*5,108 
deutero-problem, 181. 
distracted, 180 
distress, 114 
disturbance, 92, 118 
disturbed, 63, 180 

dogmatic, 78, 244 

dogs, 38, see also Subject, 

earlier contacted. 24. « 

serial order of contact 

evaluation apprehension, o . 

220 

excitement, 44 

expectancy, 132 j - expectancy, 

conflict with expenmenterc p 

193-194 

controls for, 395 compare^*' 

experimenter expectancy, 

35^ . hehavior, 82-86 

of experimenter beh v, 
experience, pleasantness, 
experienced, 261 

experimenter contact. 

failure experience, 80, 
fantasy production. 6J 

fear of immodesty, 102 
feedback, 89 

* mium! dS-te 62-6J. 7J. *0. 

female, f4'ir8. 139. 

368.405 
franVness. 57 
friendly. 75 
giERly. 

jreetmE.*** 


guilt over awareness, 190 
hallucinations, 46 

Ss!3t. see Uiso Clever Hans 
hospitalfeed, 139 

;;^^ifS;cr405-406 

hostile bigoUO 117, 236 

hi^o^h'e’sl about purpose. 189 
hysteric, 82 
imaginative, 80 

'inadequacy feelmgs, 98^^ 

incentive, , 26O 

perceived as bribery, 21» 

indifferent, 180 ^ gj. also 

.„nuenceability.6Mfr-7'‘ 

Subject, conformity 
ingratiation, 18* 

insight, self, 47.51, 56, 62-63, Ij^. 

j;ll%.ercd.56 

tape-recorded, 56 
interest. 72 g 

iail'Te" V,,;t"ron«cs. IM , 

keeping “P 92-93; see also 

major, acadentie^d?, 65. 72. 80. 

mm- 

mentally tetard'O.-” 

mice. *32 
military ’■*2’ 
mood, 81 

"''’'’"’'■'•mx t«0-18t. 2*3. ’-**<'■ 

motives. It*- 

mmement peieeption. tH 
nabe. 193 


nartc. 47. 64 9>.^ |03, 

nrvO f‘’'.J‘PP'^^B . J70. I'V 
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Segregation, racial, 40 
Self-canceling error, 11 
SelffulfiUmg prophecy, 129-133, 138, 
156, 226, 407 ff , see also Experimenter, 
expectancy 
Sensory apparatus, 14 
Sentence, construction, see Task, sentence 
construction 

Set, perception restncting, 35, see also 
Observer, effect 
Sex behavior research, 1 10 
Sex role, differentiation, 49 
Sexual content, in mixed company, 46 
Sheep, relationship to expenraenter, 38 
Shipley-Hartford Test, 72 
Signal to-noise ratio, 91 
Situation sampling, 309-310 
Situational factors and research results, 
87 ff 

Skeptic, role in science, 15 
Skinner box brightness,” 166 
Smoking, and lung cancer, 340 
Social class, lessons of, 59 
Social influence, see Influence, expen 
menter 

Social interaction, and heart disease, 20, 
see also Interaction, social 
Social psychology, 39, see also Communi 
cation 

of the psychological experiment, 27 
of unintentional influence, 401 ff, see 
also Experimenter, influence 
Socialist, interviewer, 131 
Socioemotional concern, feminine role, 49 
Sociology, see Interviewer 
Solar spectrum, prismatic, 4 
Spain, policy toward, 24 
Speech, 16, 31-32, 132, 407, see also Ex 
penmenter, behavior, auditory channel 
and Verbal conditioning 
content filtered, 407 
conversational, control by reinforce 
ment, 31-32, see also Verbal condi 
lioning 

interpretation, 16 
snmmcnng, 132 
Sprague Dawley, rat, 308 
Stanford Binet Scale, 80 
Stanford Hypnotic Susceptibility Scale 
155 

Statistical inference, 322, see also Infer- 
ence 

Statistical test, power, 24, 128 
Status, see Experimenter, status and Sub 
ject. status 
Stellar transit, 3 
Stethoscope, 6, 20 
Student, laboratory, 31, 35-36 


Subject, acceptability of response, 56-61, 
73,77,96, 103, 113, 192 
accomplice, see Accomplices 
accuracy of reading experimenter cues, 
240-241, see also Communication 
acquaintanceship with experimenter, 
see Experimenter, acquaintanceship 
and expectancy effects, 239 ff 
acquiescence, 71, see also Subject, con- 
formity 

adaptation to experimenter, 44 

adolescent, 56, 73 

age, 33, 44, 47,51, 57, 64 

aged, 33 

aggression, 80 

animal, 38, 86, 308-309, 375 
dogs, 38, 137, 177-179, 287 
horses, 38, see also Clever Hans 
mice, 137 
octopus, 6 
pi^, 137 

planana, 7-11, 178-179 
porpoises, 38 
rabbits, 10-11,90 
rats, see Rats 
sheep, 38 

worms, see Planana 
anonymity, 58, 235 

anxiety, 24, 44-45, 62, 88-90, 96, 103, 
117-118, 192, 223, 235 ff, 406 
and communication, 406 
and expectancy effects, 223 ff 
and mffuenceability, 235 ff 
evoking differential treatment, 236- 
237 

apartment dweller, 33 
apprehension over evaluation, 61, 181, 
191,220 
as client, 98 
as pupil, 87 

attitudes toward teaching methods, 71 
attributes, and expectancy effects, 226 ff 
and experimenter effects, 63, 109 
authoritarian, 71, 156 
babies, 118 

behavior, dominant, 94, 116, see also 
related subheadings under Subject 
friendly, 94, 116, see also related sub 
headings under Subject 
belief in ESP, 118, 119 
blind, 33 

character disorders, 405-406 
children, 43-44, 75, 87-88, 219 
fear of strangers, 88 
church attendance, 58-59 
class, academic, 47, 64 
college students, 45 
color perception, 114 



Subject (Cont ) 

need for approval {Cont ) 

Marlowe Crowne Social Desirability 
Scale a?id Subject, evaluation appre- 
hension 

and expectancy effects, 237 ff 
and serial order of arrival, 370 
Negro, 58-59 
neurotic, 405-406 
neutral experience, 139 
observed, 40-41, 47, see also Experi- 
menter, behavior, filmed interactions 
obsessive compulsive, 82 
opinion entrenchment, 193 
pact of Ignorance, 184 
paranoid, 139, 405-406 
passivity, 63 

patients, psychiatric, 405-406 
pay, 213 

perceived differences from experi- 
menter 114 

perception of experimenter, 76, see also 
Experimenter, behavior and Expen 
menter, subject’s view 
accuracy, 82 
perceptual style, 114 
phenomenology, 189 ff 
physiology, 59 
planana, 7-11, 178-179 
planted, 30, see also Accomplices 
pleasantness, 86 

politeness, 58-61, see also Subject, 
propriety 
porpoises, 38 

premstructional period, 47, 51, 54, see 
also Experimenter, behavior and Task 
propriety, 56-61, 71, 73, 77, 96, 103, 
113, 192, see also Subject, evaluation 
apprehension and Subject, need for 
approval 

pseudo, 30, see also Accomplices 

psychiatncally hospitalized, 405 406 

psychotic, 33 

punctilious liberal, 30 

rabbits, 10-11,90 

race, 58-59 

rapport, 82 

rating of experimenter, see Subject, 
perception of experimenter 
rats, 38, 158 ff , 308, see also Rats 
reaction time, 88-89, 209 
reinforcement, of experimenter be 
havior, 155, 302 

susceptibility, 66, see also Subject, 
conformity 

relationship to experimenter, 38. see 
also Expenmenter, behavior 
reliability, 131 


Subject Index 

resistance to influence, 220; see also 
Subject, conformity 

response, acceptability, 56-61, 71, 73, 
77,96, 103, 113, 192 
extremeness, 47, 139, 354 
public nature, 235 
variability, 47, 139, 354 
role, 49, 180 ff, 190-192, 231 
sex, 49, 231 

sexualized interpretation, 190-191 
sampling, 308-309, see also Sampling 
satisfaction, 72-73 

schizophrenic, 88-89, 132-133, 405- 
406 

‘seeing through" the experiment, 184, 
187-189, 192 
self awareness, 63 
self esteem, 181 

self presentation, 181, see also Subject, 
propriety 

self-recording of responses, 377 
self references, 73 
sequence of contact, 394 
serial order of contact, 92-93, 197, 
200-201, 208, 210, 216, 301-302, 
352 ff, 374, 394, see also Data, early 
returns 

set, 82, 96, I80ff, 209, see also Sub 
ject, expectancy 
and test reliability, 96 
speed of response, 209 
sex, 43-52, 54, 56, 72, 80, 226 ff , 274, 
275, 284, 309, see also Subject, fe 
male and Subject, male 
and expectancy effects, 226 ff 
role, 49,231 

shaping experimenter behavior, 155, 
302 

sheep, 38 

similarity to experimenter, 236 
sociability, 131 
social class, 58 
social sensitivity, 58 
socioeconomic status, 58, 60 
speaking time, 115 
stability, 131 
status, 74, 114 
dependent, 131 
success experience, 89, 139 
suggestibility, 78, 155, see also Subject, 
conformity 

susceptibility to experimenter influence, 
74-75, 95, 218, 226 ff , see also Sub- 
ject, conformity 
suspicious, 263 

suspiciousness of true purpose, 231 
teacher of experimenter, 302 
tension, 48, 51 
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Task {Cent ) 

verbal learning, 62-63 
visual motor, 80 
weight judging, 135 
word association, 23 1 
Task accomplishment and masculine role, 
49 

TAT, 90 

Taylor Scale of Manifest Anxiety (MAS), 
63-64, 89, 96, 103, 148, 233-234, 237 
Teacher, expectancy, and pupil ESP per- 
formance, 136 

and pupil IQ gam, 130-131, 409 flf 
and test sconng bias, 22 
Teaching methods, attitudes toward, 71, 
118 

Technicians, laboratory, 3 1 
Telepathy, 11, see also Extrasensory per- 
ception 
Telescope, 401 
Tension, employee, 130 
Tepoztlan, field research in, 22 
Test, standardization research, 110 
validity research, 134 
Thematic Apperception Test (TAT), 90 
Theoretical onentation, resolution of vari- 
ation, 19, 25 

Theory, availability for data interpreta- 
tion, 20 

biasing effect of, 17 ff 
Human, 88, 219 
psychoanalytic, 45 

Therapist, as data collector, 95, see also 
Experimenter 

as unintentional infiuencer, 408 ff 
attractiveness, 133 

expectancy and patient improvement, 
132 ff , 410, see also Experimenter, 
expectancy 
generalized, 115 
hostility, 115 
matched to patient, 407 
Toad, thumb pad, 29 
Tomato juice experiment, 118 
Tomcellian tube, 380 
Total blind, 367 ff, 373-374, see also 
Double-blind 

Transcnption, data, 12, see also Record- 
ing error 

Transference phenomena in the expert 
ment, 190-191 
Treatment, medical, 133 
Triadic experiment, 109, see also Prin- 
cipal investigator 
True interpretation, 16 
True value, 13-14, 16-17, 310-317, 319, 
359 

True vanance, 313 


Type I error, see Inference, errors 
Type II error, see Inference, errors 

Unintended behavior, 41, 75-77, see also 
Communication 

United States Census Bureau, 129 
United States Public Health Service, 340 
University of California, Berkeley, 166 
University of North Dakota, 144, 309 
Utrecht, clever dog of, 137 

Validity, ecological, 151, 289, 334-335, 
346, 361, 397 
index, personal, 359, 361 
research, psychometnc, 134 
Values, scientific, 3 1 
Variables, experimental, selection, 127 
Variance, biased, 312-313 
Verba! conditioning, 43, 64, 66-70, 76- 
77, 82, 89, 91, 107-108, 182, 184-186, 
189, 252, 257, 309 
awareness of influence, 182 ff 
awareness questionnaires, 184-186 
reliability, 186 
Verbal response, 79 
Verbs, hostile, 43, 70 
Vienna Medical Society, 367 / 

Virginia, reading pig, 137 
Visual channel, see Experimenter, be- 
havior, visual channel 
Visual plus auditory channels, see Ex- 
penmenter, behavior, visual plus audi- 
tory channels 

Vocational rehabilitation, 409 
Voice, of doctor, and patient treatment, 
407 

Wales, age census, 4 

War, causes, international expectancies, 
129 

Warmth, experimenter, see Experimenter, 
warmth 

Washday products, as research sponsors, 
74 

Welfare, human, basis for data suppres- 
sion, 32 

Whispering, unconscious, 135, 286 
Witchcraft attribution, in anthropological 
research, 23 

Wonder drug, faith in, 134 
Worchel Self Activity Inventory, 63 
Working true’ value, 313 
World War II, psychiatric selection bias, 
20 

X rays, interpretation as hoax, 18 
Youth in the Ghetto, 130 
Zoology, 6, 29, 401 



